Compare commits

Home / Compare a66882de .. 6c489420

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.002
σ0.371-0.369=0.001
min53.909-53.913=-0.005
max55.108-55.105=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.139-0.142=-0.003
σ0.004-0.005=-0.001
min0.133-0.137=-0.004
max0.145-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.005=0.002
min43.383-43.387=-0.004
max43.408-43.403=0.005
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.122-0.123=-0.001
σ0.003-0.004=-0.000
min0.119-0.119=-0.000
max0.129-0.131=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.005=0.002
σ1.187-1.215=-0.028
min1006.435-1006.459=-0.025
max1011.976-1012.107=-0.131
mean1053.450-1047.100=6.350
σ307.982-297.561=10.421
min578.000
max1646.000-1620.000=26.000
mean1.564-1.566=-0.001
σ0.102-0.104=-0.002
min1.389-1.403=-0.014
max1.850-1.812=0.037

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.414-0.409=0.005
σ0.151-0.139=0.011
min0.327-0.320=0.007
max0.683-0.656=0.027
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.888-0.873=0.015
σ0.102-0.088=0.013
min0.825-0.819=0.006
max1.067-1.029=0.038
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.529-0.537=-0.009
σ0.057-0.050=0.007
min0.491-0.497=-0.006
max0.630-0.614=0.015
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.846-0.841=0.004
σ0.045-0.038=0.007
min0.812-0.807=0.005
max0.921-0.903=0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.835=0.005
σ0.034-0.030=0.004
min964.813-964.810=0.002
max964.897-964.885=0.012
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.826-0.812=0.013
σ0.038-0.046=-0.008
min0.769-0.748=0.021
max0.870-0.857=0.013
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.004=0.003
min885.504
max885.522-885.515=0.007
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.728-0.724=0.004
σ0.017-0.027=-0.009
min0.699-0.678=0.021
max0.739-0.744=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.001
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean3.386-4.262=-0.876
σ0.292-0.086=0.206
min2.756-4.120=-1.364
max3.782-4.527=-0.744
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean3.570-4.253=-0.683
σ0.108-0.088=0.020
min3.347-4.125=-0.778
max3.958-4.551=-0.592
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.537-0.746=-0.209
σ0.025-0.028=-0.003
min0.508-0.708=-0.201
max0.685-0.929=-0.244
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.506-0.511=-0.005
σ0.010-0.030=-0.020
min0.486-0.489=-0.003
max0.544-0.788=-0.244

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.806-296.905=-0.099
σ0.215-0.200=0.015
min296.664-296.763=-0.099
max297.402-297.446=-0.045
mean1942.000-1900.000=42.000
σ0.000
min1942.000-1900.000=42.000
max1942.000-1900.000=42.000
mean0.591-0.561=0.030
σ0.036-0.046=-0.010
min0.532-0.500=0.032
max0.661-0.640=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.818=0.001
σ0.039-0.038=0.001
min286.769-286.767=0.003
max286.859-286.857=0.002
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.396-0.399=-0.004
σ0.008-0.009=-0.002
min0.387-0.390=-0.003
max0.402-0.412=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1297.247-1297.259=-0.012
σ0.062-0.106=-0.045
min1297.163-1297.105=0.058
max1297.303-1297.389=-0.086
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean2.076-2.213=-0.137
σ0.069-0.036=0.033
min2.013-2.151=-0.138
max2.152-2.247=-0.096
iters=5
new-facts=6402
prior-facts=1
mean1541.309-1541.416=-0.107
σ6.837-6.778=0.059
min1538.065-1538.288=-0.223
max1553.535-1553.539=-0.004
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean2.191-2.399=-0.208
σ0.105-0.244=-0.139
min2.090-2.148=-0.058
max2.357-2.768=-0.411
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.121=-0.009
σ0.084-0.057=0.027
min1858.988-1859.060=-0.072
max1859.202-1859.194=0.008
mean1788.000-1765.000=23.000
σ148.607-131.084=17.523
min1646.000-1620.000=26.000
max1942.000-1900.000=42.000
mean2.979-3.143=-0.164
σ0.086-0.333=-0.247
min2.850-2.838=0.011
max3.067-3.641=-0.574

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.227-1.293=-0.066
σ0.388-0.347=0.041
min0.930-0.929=0.001
max1.838-1.835=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.001
σ581.372-581.372=0.001
min158.131-158.134=-0.003
max1320.880-1320.879=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean0.538-0.567=-0.029
σ0.545-0.603=-0.058
min0.262-0.259=0.003
max1.356-1.472=-0.116
policies=20
mean1581.634-1581.622=0.011
σ0.367-0.364=0.004
min1581.389-1581.380=0.009
max1582.181-1582.164=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean2.649-2.644=0.005
σ0.008-0.013=-0.005
min2.642-2.634=0.009
max2.658-2.661=-0.002
policies=200
mean15824.165-15824.118=0.047
σ0.109-0.202=-0.093
min15824.018-15823.821=0.197
max15824.263-15824.274=-0.010
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1620.000=26.000
σ0.000
min1646.000-1620.000=26.000
max1646.000-1620.000=26.000
mean26.679-26.671=0.008
σ0.075-0.007=0.068
min26.586-26.664=-0.078
max26.767-26.677=0.089