Compare commits

Home / Compare 7c13e5ea .. 701bbaa0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.001
σ0.370-0.370=-0.000
min53.908-53.904=0.003
max55.108-55.107=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.143-0.142=0.001
σ0.004-0.004=-0.000
min0.140-0.138=0.002
max0.150-0.149=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.000
σ0.007-0.006=0.000
min43.386-43.384=0.002
max43.408-43.404=0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.121=-0.000
σ0.004-0.003=0.001
min0.115-0.116=-0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.002=0.003
σ1.200-1.190=0.010
min1006.436-1006.440=-0.005
max1012.036-1011.991=0.045
mean1053.350-1039.000=14.350
σ307.827-309.957=-2.130
min578.000-587.000=-9.000
max1646.000-1659.000=-13.000
mean1.538-1.552=-0.014
σ0.083-0.093=-0.009
min1.420-1.477=-0.057
max1.786-1.788=-0.002

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.425-0.416=0.009
σ0.133-0.135=-0.002
min0.341-0.337=0.004
max0.660-0.655=0.005
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.880-0.873=0.008
σ0.093-0.092=0.001
min0.804-0.820=-0.016
max1.039-1.036=0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.543-0.536=0.007
σ0.052-0.059=-0.007
min0.507-0.488=0.019
max0.630-0.637=-0.007
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=-0.001
min2.360
max2.364-2.365=-0.002
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.855-0.836=0.019
σ0.036-0.039=-0.003
min0.817-0.805=0.012
max0.914-0.902=0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.000
σ0.034-0.034=-0.000
min964.811-964.812=-0.001
max964.896-964.897=-0.001
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.826-0.824=0.001
σ0.033-0.054=-0.021
min0.773-0.750=0.023
max0.851-0.864=-0.013
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.001
σ0.007-0.008=-0.000
min885.505-885.505=-0.000
max885.522-885.523=-0.001
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.723-0.707=0.015
σ0.034-0.065=-0.031
min0.663-0.594=0.068
max0.740-0.755=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.720=0.000
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean4.249-4.215=0.033
σ0.080-0.088=-0.007
min4.100-4.050=0.050
max4.544-4.631=-0.087
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean4.242-4.203=0.039
σ0.070-0.079=-0.009
min4.091-4.077=0.014
max4.438-4.489=-0.051
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.746-0.738=0.008
σ0.019-0.017=0.002
min0.709-0.699=0.011
max0.848-0.848=-0.000
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.705-0.704=0.000
σ0.026-0.015=0.011
min0.506-0.676=-0.170
max0.794-0.776=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.902-296.889=0.014
σ0.268-0.283=-0.015
min296.723-296.674=0.049
max297.646-297.669=-0.023
mean1915.000-2029.000=-114.000
σ0.000
min1915.000-2029.000=-114.000
max1915.000-2029.000=-114.000
mean0.581-0.554=0.027
σ0.047-0.033=0.014
min0.518-0.505=0.013
max0.675-0.601=0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.821=0.001
σ0.042-0.037=0.005
min286.769-286.767=0.002
max286.867-286.858=0.009
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.396-0.396=0.001
σ0.007-0.008=-0.001
min0.388-0.386=0.002
max0.402-0.405=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.236-1297.282=-0.046
σ0.067-0.084=-0.017
min1297.169-1297.176=-0.008
max1297.328-1297.399=-0.072
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean2.100-2.245=-0.144
σ0.074-0.061=0.013
min2.010-2.190=-0.180
max2.169-2.343=-0.174
iters=5
new-facts=6402
prior-facts=1
mean1541.336-1541.335=0.001
σ6.817-6.814=0.003
min1538.133-1538.108=0.025
max1553.528-1553.522=0.007
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean2.259-2.197=0.062
σ0.292-0.090=0.203
min1.977-2.086=-0.109
max2.738-2.310=0.429
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.115=-0.004
σ0.081-0.066=0.015
min1858.992-1859.026=-0.033
max1859.189-1859.184=0.005
mean1773.800-1794.000=-20.200
σ135.332-164.824=-29.492
min1646.000-1659.000=-13.000
max1915.000-2029.000=-114.000
mean3.055-3.038=0.017
σ0.142-0.306=-0.163
min2.850-2.807=0.043
max3.211-3.553=-0.342

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.227-1.259=-0.032
σ0.351-0.420=-0.069
min0.934-0.932=0.002
max1.821-1.843=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.822=-0.003
σ581.372-581.372=-0.000
min158.132-158.134=-0.003
max1320.877-1320.880=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean0.554-0.563=-0.009
σ0.567-0.601=-0.034
min0.268-0.258=0.011
max1.405-1.464=-0.059
policies=20
mean1581.605-1581.631=-0.026
σ0.359-0.363=-0.004
min1581.357-1581.386=-0.030
max1582.138-1582.170=-0.032
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean2.631-2.644=-0.013
σ0.022-0.023=-0.001
min2.603-2.626=-0.023
max2.656-2.678=-0.022
policies=200
mean15824.068-15824.187=-0.120
σ0.098-0.068=0.030
min15823.996-15824.115=-0.119
max15824.212-15824.267=-0.055
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1659.000=-13.000
σ0.000
min1646.000-1659.000=-13.000
max1646.000-1659.000=-13.000
mean26.584-26.688=-0.103
σ0.035-0.062=-0.027
min26.550-26.602=-0.052
max26.630-26.748=-0.119