Compare commits

Home / Compare 7f54161c .. 9e77db61

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.057=-0.002
σ0.371-0.370=0.001
min53.911-53.918=-0.008
max55.111-55.111=0.000
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.138-0.139=-0.000
σ0.005-0.004=0.001
min0.131-0.134=-0.003
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.006-0.007=-0.001
min43.384-43.388=-0.003
max43.403-43.412=-0.010
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.001
min0.115-0.119=-0.004
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.960-1007.029=-0.068
σ0.870-1.189=-0.319
min1006.462-1006.451=0.012
max1010.558-1012.011=-1.453
mean1046.350-1053.000=-6.650
σ292.468-307.619=-15.150
min605.000-578.000=27.000
max1431.000-1645.000=-214.000
mean1.540-1.521=0.019
σ0.044-0.058=-0.014
min1.482-1.439=0.043
max1.641-1.659=-0.019

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.414-0.414=0.000
σ0.134-0.124=0.010
min0.331-0.344=-0.013
max0.651-0.633=0.017
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.878-0.886=-0.008
σ0.092-0.095=-0.003
min0.811-0.827=-0.016
max1.036-1.052=-0.016
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.539-0.536=0.003
σ0.044-0.048=-0.004
min0.504-0.490=0.014
max0.615-0.614=0.000
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.845-0.850=-0.004
σ0.042-0.033=0.009
min0.813-0.818=-0.005
max0.919-0.901=0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.820-964.840=-0.019
σ0.023-0.036=-0.013
min964.802-964.809=-0.007
max964.857-964.899=-0.041
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.823-0.839=-0.015
σ0.035-0.022=0.013
min0.784-0.815=-0.030
max0.854-0.858=-0.004
name=cdr_enhanced_4k_loc.art
mean885.510-885.512=-0.002
σ0.006-0.008=-0.002
min885.504
max885.516-885.523=-0.007
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.703-0.727=-0.024
σ0.039-0.017=0.022
min0.663-0.698=-0.036
max0.750-0.741=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean4.216-4.244=-0.028
σ0.073-0.076=-0.003
min4.116-4.101=0.014
max4.550-4.521=0.029
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean4.217-4.259=-0.042
σ0.063-0.073=-0.010
min4.100-4.131=-0.032
max4.477-4.646=-0.169
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.743-0.752=-0.010
σ0.021-0.018=0.003
min0.656-0.718=-0.062
max0.854-0.859=-0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.699-0.710=-0.011
σ0.016-0.016=-0.000
min0.670-0.679=-0.008
max0.783-0.796=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.520-296.898=-1.377
σ0.207-0.243=-0.035
min295.373-296.613=-1.240
max296.088-297.498=-1.410
mean1904.000-1902.000=2.000
σ0.000
min1904.000-1902.000=2.000
max1904.000-1902.000=2.000
mean0.573-0.575=-0.001
σ0.045-0.055=-0.010
min0.501-0.499=0.002
max0.619-0.691=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.399-286.839=-1.440
σ0.038-0.039=-0.001
min285.348-286.790=-1.441
max285.438-286.879=-1.441
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.391-0.393=-0.002
σ0.009-0.005=0.004
min0.381-0.388=-0.006
max0.403-0.400=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.774-1297.234=-1.460
σ0.107-0.111=-0.005
min1295.665-1297.107=-1.442
max1295.904-1297.367=-1.463
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean1.926-1.890=0.036
σ0.098-0.091=0.007
min1.820-1.799=0.021
max2.039-2.023=0.016
iters=5
new-facts=6402
prior-facts=1
mean1539.914-1541.378=-1.464
σ6.818-6.834=-0.017
min1536.654-1538.101=-1.448
max1552.105-1553.599=-1.494
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean2.376-2.365=0.011
σ0.235-0.244=-0.010
min2.053-2.013=0.040
max2.692-2.617=0.075
iters=5
new-facts=6402
prior-facts=6402
mean1857.687-1859.149=-1.462
σ0.068-0.061=0.007
min1857.601-1859.086=-1.485
max1857.769-1859.233=-1.463
mean1741.400-1784.200=-42.800
σ185.554-123.242=62.312
min1469.000-1645.000=-176.000
max1904.000-1902.000=2.000
mean3.041-2.952=0.089
σ0.167-0.085=0.082
min2.874-2.828=0.046
max3.308-3.063=0.245

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.750-1.204=0.546
σ0.038-0.374=-0.336
min1.702-0.932=0.770
max1.783-1.826=-0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.559-448.867=-3.308
σ580.640-581.372=-0.732
min155.237-158.179=-2.942
max1316.519-1320.925=-4.405
mean96.250
σ8.500
min92.000
max109.000
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean0.537-0.563=-0.026
σ0.551-0.602=-0.051
min0.259-0.261=-0.002
max1.363-1.465=-0.102
policies=20
mean1552.651-1582.074=-29.423
σ0.333-0.356=-0.023
min1552.425-1581.833=-29.408
max1553.146-1582.603=-29.457
mean920.000
σ0.000
min920.000
max920.000
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean2.601-2.630=-0.029
σ0.011-0.016=-0.006
min2.585-2.607=-0.022
max2.610-2.643=-0.033
policies=200
mean15534.489-15828.830=-294.341
σ0.077-0.105=-0.028
min15534.405-15828.745=-294.341
max15534.581-15828.982=-294.401
mean9200.000
σ0.000
min9200.000
max9200.000
mean1431.000-1645.000=-214.000
σ0.000
min1431.000-1645.000=-214.000
max1431.000-1645.000=-214.000
mean26.211-26.677=-0.465
σ0.053-0.035=0.018
min26.137-26.647=-0.509
max26.254-26.726=-0.472