Compare commits

Home / Compare c0e5cd1f .. 7920e064

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.002
σ0.368-0.367=0.001
min53.911-53.914=-0.004
max55.105-55.100=0.005
mean422.000-417.000=5.000
σ0.000
min422.000-417.000=5.000
max422.000-417.000=5.000
mean0.140-0.140=0.000
σ0.004-0.004=0.000
min0.135-0.136=-0.000
max0.148-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=0.000
σ0.007-0.006=0.001
min43.384-43.384=0.001
max43.406-43.404=0.002
mean422.000-417.000=5.000
σ0.000
min422.000-417.000=5.000
max422.000-417.000=5.000
mean0.121-0.122=-0.001
σ0.004-0.003=0.001
min0.114-0.119=-0.005
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.963-1006.966=-0.004
σ0.870-0.860=0.010
min1006.464-1006.463=0.001
max1010.564-1010.512=0.052
mean1043.750-1055.850=-12.100
σ291.246-316.290=-25.044
min580.000-566.000=14.000
max1458.000-1620.000=-162.000
mean1.538-1.530=0.008
σ0.055-0.050=0.005
min1.480-1.463=0.017
max1.627-1.666=-0.039

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.419-0.416=0.003
σ0.133-0.132=0.000
min0.339-0.333=0.006
max0.654-0.652=0.003
name=error_case.art
mean2.339-2.339=0.000
σ0.002-0.003=-0.000
min2.337
max2.342
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.888-0.894=-0.007
σ0.088-0.094=-0.006
min0.836-0.836=-0.001
max1.044-1.060=-0.016
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.539-0.536=0.003
σ0.045-0.058=-0.012
min0.491-0.483=0.009
max0.603-0.627=-0.025
name=nested_use.art
mean2.361-2.361=0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.843-0.841=0.002
σ0.042-0.033=0.009
min0.817-0.814=0.003
max0.916-0.896=0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.823-964.837=-0.014
σ0.027-0.027=-0.000
min964.802-964.816=-0.014
max964.868-964.881=-0.013
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.804-0.826=-0.022
σ0.057-0.028=0.029
min0.710-0.798=-0.088
max0.851-0.859=-0.007
name=cdr_enhanced_4k_loc.art
mean885.510-885.512=-0.002
σ0.007-0.007=0.000
min885.504
max885.521-885.522=-0.001
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.711-0.728=-0.017
σ0.039-0.013=0.026
min0.666-0.708=-0.042
max0.748-0.743=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.001
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean4.231-4.233=-0.003
σ0.104-0.093=0.011
min4.070-4.081=-0.012
max4.897-4.753=0.144
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean4.214-4.212=0.002
σ0.085-0.073=0.012
min4.059-4.083=-0.024
max4.459-4.449=0.010
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.733-0.726=0.006
σ0.020-0.055=-0.035
min0.698-0.525=0.174
max0.861-0.853=0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.693-0.699=-0.005
σ0.041-0.014=0.027
min0.524-0.669=-0.144
max0.764-0.765=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.528-295.723=-0.195
σ0.262-0.208=0.054
min295.311-295.600=-0.289
max296.247-296.292=-0.045
mean1901.000-1902.000=-1.000
σ0.000
min1901.000-1902.000=-1.000
max1901.000-1902.000=-1.000
mean0.560-0.584=-0.024
σ0.042-0.045=-0.003
min0.504-0.509=-0.004
max0.616-0.682=-0.065

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.398-285.396=0.002
σ0.035-0.033=0.003
min285.351-285.357=-0.006
max285.440-285.440=0.000
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.389-0.382=0.007
σ0.010-0.005=0.005
min0.383-0.379=0.004
max0.406-0.390=0.016
iters=5
new-facts=1
prior-facts=6402
mean1295.787-1295.788=-0.001
σ0.120-0.124=-0.003
min1295.655-1295.657=-0.001
max1295.920-1295.923=-0.003
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean1.940-1.945=-0.004
σ0.083-0.081=0.002
min1.846-1.840=0.006
max2.066-2.061=0.005
iters=5
new-facts=6402
prior-facts=1
mean1538.635-1538.632=0.003
σ3.991-3.969=0.022
min1536.621-1536.635=-0.013
max1545.764-1545.721=0.043
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean2.281-2.245=0.036
σ0.135-0.147=-0.013
min2.107-2.097=0.010
max2.479-2.479=0.001
iters=5
new-facts=6402
prior-facts=6402
mean1857.689-1857.685=0.004
σ0.066-0.068=-0.002
min1857.609-1857.608=0.001
max1857.776-1857.782=-0.005
mean1727.600-1756.400=-28.800
σ179.087-141.375=37.713
min1500.000-1620.000=-120.000
max1901.000-1902.000=-1.000
mean3.025-2.918=0.107
σ0.344-0.112=0.233
min2.661-2.813=-0.152
max3.597-3.101=0.496

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.689-1.182=0.507
σ0.162-0.338=-0.177
min1.477-0.928=0.548
max1.849-1.756=0.092

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.026-444.027=-0.002
σ577.574-577.575=-0.000
min155.237-155.239=-0.002
max1310.388-1310.389=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean0.526-0.551=-0.025
σ0.543-0.559=-0.016
min0.241-0.270=-0.029
max1.340-1.389=-0.049
policies=20
mean1552.642-1552.656=-0.014
σ0.332-0.321=0.010
min1552.414-1552.433=-0.020
max1553.135-1553.133=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean2.593-2.584=0.010
σ0.009-0.025=-0.015
min2.586-2.567=0.019
max2.606-2.619=-0.013
policies=200
mean15534.643-15534.726=-0.083
σ0.259-0.049=0.210
min15534.287-15534.675=-0.388
max15534.904-15534.777=0.127
mean9200.000
σ0.000
min9200.000
max9200.000
mean1458.000-1620.000=-162.000
σ0.000
min1458.000-1620.000=-162.000
max1458.000-1620.000=-162.000
mean26.120-26.094=0.025
σ0.038-0.175=-0.137
min26.067-25.972=0.095
max26.156-26.351=-0.196