Compare commits

Home / Compare edf5c7de .. a8747a42

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.000
σ0.370-0.370=0.000
min53.903-53.904=-0.001
max55.108-55.107=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.141-0.141=0.000
σ0.004-0.006=-0.001
min0.134-0.136=-0.001
max0.147-0.152=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.392-43.392=-0.000
σ0.006-0.007=-0.001
min43.382-43.383=-0.001
max43.404-43.407=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.001
min0.114-0.119=-0.004
max0.128-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.005=-0.003
σ1.193-1.187=0.006
min1006.445-1006.433=0.012
max1012.008-1011.983=0.026
mean1039.550-1049.800=-10.250
σ298.301-307.983=-9.682
min582.000-577.000=5.000
max1585.000-1639.000=-54.000
mean1.530-1.531=-0.001
σ0.124-0.080=0.044
min1.330-1.457=-0.128
max1.837-1.777=0.059

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.412-0.425=-0.012
σ0.121-0.144=-0.023
min0.340-0.344=-0.004
max0.626-0.681=-0.054
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.872-0.969=-0.097
σ0.077-0.194=-0.118
min0.822-0.849=-0.027
max1.006-1.307=-0.302
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.543-0.536=0.007
σ0.048-0.047=0.002
min0.503-0.501=0.002
max0.622-0.615=0.007
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.846-0.845=0.001
σ0.033-0.033=0.000
min0.816-0.817=-0.001
max0.898-0.901=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.839=-0.004
σ0.029-0.034=-0.005
min964.819-964.811=0.009
max964.886-964.894=-0.008
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.818-0.823=-0.005
σ0.040-0.038=0.002
min0.749-0.770=-0.021
max0.849-0.863=-0.014
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.001
σ0.005-0.008=-0.003
min885.504
max885.515-885.523=-0.009
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.706-0.742=-0.036
σ0.015-0.011=0.004
min0.686-0.727=-0.041
max0.727-0.752=-0.026

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean4.270-4.238=0.032
σ0.078-0.094=-0.016
min4.161-4.089=0.072
max4.730-4.668=0.062
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean4.309-4.241=0.068
σ0.103-0.067=0.036
min4.172-4.116=0.056
max4.685-4.401=0.284
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.614-0.755=-0.141
σ0.109-0.020=0.089
min0.515-0.718=-0.202
max0.862-0.869=-0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.515-0.705=-0.190
σ0.019-0.049=-0.030
min0.492-0.505=-0.013
max0.673-0.776=-0.103

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.900-296.939=-0.039
σ0.263-0.200=0.063
min296.725-296.772=-0.047
max297.626-297.446=0.181
mean1900.000-1928.000=-28.000
σ0.000
min1900.000-1928.000=-28.000
max1900.000-1928.000=-28.000
mean0.573-0.570=0.002
σ0.055-0.042=0.013
min0.507-0.503=0.004
max0.695-0.637=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.819=0.002
σ0.037-0.041=-0.004
min286.769-286.774=-0.005
max286.859-286.868=-0.009
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.395-0.400=-0.005
σ0.007-0.006=0.001
min0.387-0.391=-0.003
max0.401-0.405=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.212-1297.253=-0.041
σ0.069-0.048=0.020
min1297.131-1297.199=-0.068
max1297.296-1297.305=-0.009
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean2.054-2.163=-0.109
σ0.051-0.092=-0.041
min2.004-2.036=-0.032
max2.129-2.287=-0.158
iters=5
new-facts=6402
prior-facts=1
mean1541.363-1541.352=0.011
σ6.809-6.823=-0.014
min1538.150-1538.131=0.019
max1553.540-1553.554=-0.014
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean2.343-2.312=0.031
σ0.232-0.168=0.064
min2.102-2.129=-0.027
max2.700-2.524=0.176
iters=5
new-facts=6402
prior-facts=6402
mean1859.122-1859.115=0.008
σ0.067-0.078=-0.011
min1859.038-1858.998=0.040
max1859.202-1859.193=0.009
mean1758.600-1786.400=-27.800
σ141.081-142.047=-0.966
min1585.000-1639.000=-54.000
max1900.000-1928.000=-28.000
mean3.020-3.138=-0.118
σ0.360-0.328=0.032
min2.714-2.867=-0.153
max3.542-3.636=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.279-1.219=0.060
σ0.388-0.335=0.053
min0.930-0.942=-0.012
max1.866-1.758=0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.818-448.822=-0.004
σ581.373-581.372=0.001
min158.129-158.134=-0.005
max1320.878-1320.880=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean0.555-0.541=0.014
σ0.577-0.543=0.034
min0.263-0.269=-0.006
max1.420-1.355=0.065
policies=20
mean1581.606-1581.626=-0.019
σ0.352-0.352=0.000
min1581.370-1581.389=-0.019
max1582.130-1582.150=-0.019
mean920.000
σ0.000
min920.000
max920.000
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean2.635-2.628=0.007
σ0.007-0.017=-0.011
min2.630-2.610=0.020
max2.645-2.649=-0.005
policies=200
mean15824.104-15824.159=-0.055
σ0.130-0.167=-0.037
min15823.995-15824.049=-0.054
max15824.292-15824.407=-0.116
mean9200.000
σ0.000
min9200.000
max9200.000
mean1585.000-1639.000=-54.000
σ0.000
min1585.000-1639.000=-54.000
max1585.000-1639.000=-54.000
mean26.592-26.641=-0.049
σ0.051-0.115=-0.065
min26.518-26.485=0.033
max26.630-26.750=-0.120