Compare commits

Home / Compare a8cfd6c3 .. 1edd910e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.370-0.368=0.001
min53.915-53.910=0.005
max55.106-55.101=0.005
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.141-0.141=-0.000
σ0.004-0.003=0.001
min0.138-0.138=-0.000
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.392-43.394=-0.001
σ0.007-0.006=0.001
min43.380-43.383=-0.003
max43.403-43.405=-0.002
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.120-0.122=-0.003
σ0.005-0.004=0.001
min0.115-0.116=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.004=-0.003
σ1.225-1.191=0.034
min1006.465-1006.434=0.031
max1012.147-1011.996=0.152
mean1051.050-1056.350=-5.300
σ308.909-305.537=3.372
min576.000-582.000=-6.000
max1648.000-1650.000=-2.000
mean1.567-1.543=0.025
σ0.085-0.080=0.004
min1.486-1.440=0.046
max1.820-1.755=0.065

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.406-0.419=-0.013
σ0.109-0.137=-0.028
min0.329-0.347=-0.018
max0.595-0.663=-0.068
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.882-0.890=-0.008
σ0.072-0.113=-0.040
min0.824-0.820=0.004
max1.003-1.088=-0.085
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.567-0.535=0.032
σ0.066-0.053=0.013
min0.513-0.501=0.011
max0.651-0.625=0.026
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.869-0.847=0.022
σ0.047-0.030=0.017
min0.830-0.824=0.006
max0.940-0.896=0.044

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.035-0.034=0.001
min964.811
max964.896-964.895=0.001
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.839-0.833=0.006
σ0.023-0.022=0.001
min0.812-0.804=0.008
max0.860-0.854=0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=0.000
min885.505
max885.523-885.523=0.000
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.718-0.713=0.005
σ0.022-0.013=0.008
min0.689-0.703=-0.014
max0.740-0.731=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.723-7.721=0.002
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean4.238-3.893=0.344
σ0.075-0.395=-0.321
min4.129-3.365=0.764
max4.501-4.511=-0.010
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean4.227-3.475=0.752
σ0.080-0.067=0.014
min4.079-3.351=0.728
max4.655-3.735=0.920
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.734-0.731=0.003
σ0.027-0.017=0.010
min0.703-0.704=-0.001
max0.920-0.845=0.075
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.511-0.696=-0.185
σ0.039-0.014=0.025
min0.480-0.669=-0.189
max0.804-0.768=0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.091-297.026=0.065
σ0.230-0.235=-0.006
min296.884-296.791=0.093
max297.689-297.639=0.050
mean1902.000-2039.000=-137.000
σ0.000
min1902.000-2039.000=-137.000
max1902.000-2039.000=-137.000
mean0.577-0.549=0.028
σ0.046-0.034=0.012
min0.508-0.500=0.007
max0.663-0.581=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-286.816=0.008
σ0.039-0.040=-0.001
min286.773-286.760=0.013
max286.866-286.858=0.008
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.396-0.397=-0.001
σ0.008-0.010=-0.002
min0.387-0.389=-0.002
max0.404-0.412=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1297.269-1297.230=0.039
σ0.079-0.077=0.002
min1297.159-1297.144=0.014
max1297.364-1297.326=0.038
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean2.168-2.088=0.079
σ0.093-0.066=0.027
min2.020-2.018=0.002
max2.271-2.174=0.098
iters=5
new-facts=6402
prior-facts=1
mean1541.352-1541.349=0.003
σ6.805-6.830=-0.025
min1538.136-1538.154=-0.018
max1553.523-1553.564=-0.041
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean2.270-2.293=-0.024
σ0.117-0.240=-0.123
min2.168-2.123=0.044
max2.458-2.686=-0.229
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.114=0.001
σ0.068-0.076=-0.008
min1859.026-1858.992=0.034
max1859.197-1859.188=0.008
mean1775.200-1787.000=-11.800
σ125.784-168.882=-43.097
min1648.000-1650.000=-2.000
max1902.000-2039.000=-137.000
mean3.110-2.903=0.208
σ0.420-0.103=0.317
min2.661-2.795=-0.134
max3.761-3.061=0.701

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.198=0.008
σ0.336-0.360=-0.023
min0.931-0.939=-0.007
max1.768-1.797=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=0.000
σ581.372-581.372=0.000
min158.135-158.135=0.001
max1320.880-1320.880=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean0.533-0.552=-0.019
σ0.535-0.570=-0.035
min0.262-0.263=-0.001
max1.336-1.407=-0.072
policies=20
mean1581.629-1581.635=-0.006
σ0.363-0.365=-0.002
min1581.383-1581.389=-0.007
max1582.169-1582.178=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean2.651-2.641=0.010
σ0.006-0.015=-0.009
min2.647-2.624=0.023
max2.659-2.658=0.001
policies=200
mean15824.181-15824.203=-0.022
σ0.110-0.059=0.051
min15824.025-15824.140=-0.115
max15824.264-15824.273=-0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1650.000=-2.000
σ0.000
min1648.000-1650.000=-2.000
max1648.000-1650.000=-2.000
mean26.775-26.692=0.083
σ0.098-0.028=0.070
min26.706-26.665=0.041
max26.919-26.731=0.189