Compare commits

Home / Compare 3c50123e .. fb1a049f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.369-0.369=0.001
min53.917-53.916=0.001
max55.106-55.104=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.138=0.002
σ0.004-0.003=0.001
min0.136-0.135=0.001
max0.147-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.006-0.007=-0.001
min43.385-43.386=-0.002
max43.405-43.408=-0.003
mean416.900-417.000=-0.100
σ0.316-0.000=0.316
min416.000-417.000=-1.000
max417.000
mean0.122-0.122=-0.000
σ0.003-0.003=-0.000
min0.120-0.119=0.001
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.004=-0.002
σ1.207-1.198=0.009
min1006.443-1006.434=0.009
max1012.067-1012.026=0.041
mean1053.050-1052.250=0.800
σ320.471-307.096=13.375
min571.000-579.000=-8.000
max1620.000-1636.000=-16.000
mean1.541-1.561=-0.020
σ0.069-0.093=-0.024
min1.404-1.473=-0.069
max1.710-1.843=-0.132

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.408-0.397=0.011
σ0.113-0.106=0.007
min0.343-0.332=0.011
max0.610-0.585=0.025
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.937-0.877=0.060
σ0.202-0.089=0.113
min0.827-0.819=0.008
max1.297-1.035=0.262
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.539-0.536=0.002
σ0.043-0.044=-0.001
min0.505-0.501=0.004
max0.610-0.610=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.837-0.839=-0.002
σ0.039-0.054=-0.015
min0.792-0.804=-0.012
max0.896-0.933=-0.037

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.000
σ0.034-0.036=-0.002
min964.810-964.808=0.002
max964.895-964.900=-0.005
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.839-0.833=0.007
σ0.021-0.029=-0.008
min0.815-0.791=0.023
max0.866-0.864=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.008=-0.001
min885.506-885.504=0.001
max885.523-885.523=-0.000
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.684-0.717=-0.033
σ0.071-0.046=0.024
min0.607-0.636=-0.029
max0.745-0.749=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.720=0.000
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean4.242-4.218=0.024
σ0.105-0.090=0.015
min4.072-4.046=0.026
max4.771-4.580=0.191
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean4.226-4.182=0.044
σ0.073-0.087=-0.014
min4.108-4.041=0.067
max4.478-4.485=-0.007
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.741-0.739=0.002
σ0.021-0.017=0.005
min0.669-0.706=-0.036
max0.869-0.838=0.032
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.698-0.701=-0.003
σ0.016-0.014=0.002
min0.670-0.670=0.000
max0.785-0.763=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.144-296.963=0.181
σ0.219-0.193=0.026
min296.884-296.831=0.053
max297.577-297.485=0.092
mean2032.000-1919.000=113.000
σ0.000
min2032.000-1919.000=113.000
max2032.000-1919.000=113.000
mean0.547-0.569=-0.023
σ0.033-0.057=-0.024
min0.499-0.499=-0.000
max0.587-0.670=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.825=-0.005
σ0.040-0.038=0.002
min286.768-286.774=-0.006
max286.862-286.863=-0.002
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.397-0.399=-0.002
σ0.007-0.007=-0.000
min0.389-0.390=-0.002
max0.404-0.404=0.000
iters=5
new-facts=1
prior-facts=6402
mean1297.208-1297.221=-0.013
σ0.110-0.114=-0.004
min1297.085-1297.096=-0.011
max1297.355-1297.369=-0.013
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean1.874-1.900=-0.026
σ0.067-0.079=-0.012
min1.798-1.811=-0.012
max1.933-1.985=-0.052
iters=5
new-facts=6402
prior-facts=1
mean1541.341-1541.315=0.025
σ6.827-6.836=-0.010
min1538.100-1538.096=0.003
max1553.550-1553.541=0.009
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean2.147-2.161=-0.014
σ0.132-0.139=-0.007
min2.047-1.978=0.069
max2.371-2.338=0.033
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.123=-0.011
σ0.061-0.057=0.004
min1859.052-1859.062=-0.010
max1859.193-1859.200=-0.006
mean1771.200-1773.600=-2.400
σ178.469-141.768=36.701
min1620.000-1636.000=-16.000
max2032.000-1919.000=113.000
mean2.889-3.017=-0.128
σ0.041-0.131=-0.090
min2.858-2.848=0.010
max2.956-3.132=-0.176

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-1.224=-0.007
σ0.317-0.297=0.020
min0.937-0.936=0.001
max1.746-1.683=0.063

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=-0.001
min158.134-158.135=-0.000
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean0.547-0.553=-0.006
σ0.559-0.578=-0.019
min0.265-0.254=0.011
max1.386-1.420=-0.035
policies=20
mean1581.629-1581.628=0.001
σ0.364-0.362=0.002
min1581.387-1581.382=0.005
max1582.171-1582.166=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean2.643-2.644=-0.001
σ0.007-0.009=-0.002
min2.637-2.635=0.002
max2.651-2.655=-0.004
policies=200
mean15824.142-15824.150=-0.009
σ0.109-0.177=-0.068
min15824.014-15824.014=0.000
max15824.273-15824.408=-0.135
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1636.000=-16.000
σ0.000
min1620.000-1636.000=-16.000
max1620.000-1636.000=-16.000
mean26.595-26.648=-0.053
σ0.025-0.025=-0.000
min26.564-26.629=-0.065
max26.619-26.684=-0.065