Compare commits

Home / Compare 915ad812 .. 85f6f9b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.017=-0.002
σ0.371-0.369=0.002
min53.867-53.875=-0.008
max55.070-55.066=0.005
mean417.000-415.900=1.100
σ0.000-0.316=-0.316
min417.000-415.000=2.000
max417.000-416.000=1.000
mean0.140-0.147=-0.007
σ0.005-0.008=-0.003
min0.134-0.138=-0.003
max0.149-0.159=-0.011
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.008-0.006=0.002
min43.308-43.315=-0.007
max43.337-43.337=-0.000
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.122-0.123=-0.001
σ0.004-0.003=0.001
min0.118-0.120=-0.002
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.310=-0.001
σ1.162-1.175=-0.014
min1005.764-1005.751=0.013
max1011.170-1011.232=-0.062
mean1044.550-1047.400=-2.850
σ313.036-313.551=-0.514
min596.000-597.000=-1.000
max1639.000-1645.000=-6.000
mean1.572-1.546=0.026
σ0.100-0.068=0.031
min1.455-1.481=-0.026
max1.833-1.723=0.110

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.419-0.418=0.001
σ0.147-0.137=0.010
min0.339-0.348=-0.009
max0.680-0.663=0.017
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.874-0.902=-0.029
σ0.106-0.103=0.002
min0.810-0.824=-0.014
max1.061-1.081=-0.020
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.535-0.555=-0.021
σ0.049-0.054=-0.006
min0.494-0.503=-0.009
max0.619-0.642=-0.023
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.836-0.860=-0.024
σ0.035-0.034=0.002
min0.811-0.833=-0.022
max0.897-0.918=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.001
σ0.034-0.034=-0.000
min964.087-964.087=0.000
max964.171-964.171=0.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.838-0.788=0.051
σ0.025-0.055=-0.030
min0.808-0.736=0.072
max0.860-0.865=-0.006
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=0.001
σ0.008-0.006=0.001
min884.703
max884.722-884.717=0.005
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.708-0.726=-0.018
σ0.041-0.022=0.019
min0.641-0.690=-0.048
max0.743-0.746=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.003
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean4.250-4.207=0.043
σ0.095-0.067=0.029
min4.084-4.100=-0.016
max4.633-4.486=0.147
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.668=-0.002
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean4.243-4.204=0.039
σ0.082-0.118=-0.036
min4.115-4.084=0.031
max4.513-5.138=-0.625
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.735-0.741=-0.006
σ0.020-0.019=0.001
min0.697-0.706=-0.009
max0.869-0.862=0.008
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.696-0.697=-0.001
σ0.017-0.013=0.003
min0.669-0.674=-0.005
max0.791-0.771=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.235-296.263=-0.029
σ0.185-0.227=-0.042
min296.061-296.076=-0.015
max296.705-296.870=-0.165
mean1907.000-1918.000=-11.000
σ0.000
min1907.000-1918.000=-11.000
max1907.000-1918.000=-11.000
mean0.583-0.588=-0.005
σ0.031-0.013=0.018
min0.531-0.564=-0.034
max0.629-0.598=0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.703-284.694=0.009
σ0.031-0.039=-0.008
min284.672-284.639=0.033
max284.740-284.735=0.005
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.398-0.397=0.001
σ0.011-0.011=-0.000
min0.385-0.385=0.001
max0.409-0.407=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.082-1295.076=0.006
σ0.112-0.109=0.003
min1294.954-1294.959=-0.004
max1295.214-1295.208=0.005
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean1.869-1.902=-0.033
σ0.066-0.095=-0.030
min1.807-1.802=0.005
max1.966-2.020=-0.054
iters=5
new-facts=6402
prior-facts=1
mean1539.210-1539.192=0.019
σ6.845-6.852=-0.006
min1535.911-1535.926=-0.015
max1551.450-1551.445=0.005
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.326-2.275=0.051
σ0.213-0.272=-0.059
min2.026-2.056=-0.030
max2.592-2.696=-0.105
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.986=0.000
σ0.055-0.060=-0.005
min1856.941-1856.926=0.015
max1857.072-1857.071=0.001
mean1772.600-1777.000=-4.400
σ130.494-136.261=-5.766
min1639.000-1645.000=-6.000
max1907.000-1918.000=-11.000
mean3.048-3.030=0.018
σ0.237-0.189=0.048
min2.857-2.855=0.002
max3.453-3.347=0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.225=0.001
σ0.331-0.256=0.075
min0.938-0.955=-0.017
max1.779-1.521=0.258

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.000
σ581.213-581.213=0.000
min157.176-157.176=0.000
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.545-0.542=0.002
σ0.555-0.564=-0.008
min0.264-0.257=0.007
max1.378-1.388=-0.010
policies=20
mean1572.105-1572.103=0.002
σ0.356-0.358=-0.002
min1571.868-1571.860=0.007
max1572.635-1572.636=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.634-2.629=0.006
σ0.008-0.013=-0.005
min2.627-2.613=0.014
max2.646-2.643=0.004
policies=200
mean15729.064-15728.985=0.079
σ0.084-0.168=-0.085
min15729.013-15728.891=0.122
max15729.189-15729.237=-0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean26.495-26.604=-0.109
σ0.024-0.097=-0.073
min26.481-26.539=-0.059
max26.530-26.747=-0.217