Compare commits

Home / Compare 756c08a0 .. 4f1cae93

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.368=0.003
min53.872-53.868=0.004
max55.070-55.062=0.008
mean420.000-413.700=6.300
σ0.000-0.483=-0.483
min420.000-413.000=7.000
max420.000-414.000=6.000
mean0.138-0.139=-0.000
σ0.003-0.004=-0.000
min0.135-0.135=-0.000
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.324-43.323=0.001
σ0.007-0.007=0.000
min43.314-43.314=0.000
max43.339-43.333=0.007
mean420.000-414.000=6.000
σ0.000
min420.000-414.000=6.000
max420.000-414.000=6.000
mean0.122-0.121=0.001
σ0.003-0.004=-0.001
min0.119-0.118=0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.317=-0.011
σ1.175-1.153=0.023
min1005.768-1005.744=0.024
max1011.226-1011.129=0.097
mean1056.700-1046.100=10.600
σ304.927-314.234=-9.306
min603.000-577.000=26.000
max1650.000-1643.000=7.000
mean1.554-1.557=-0.002
σ0.080-0.080=0.000
min1.446-1.479=-0.032
max1.772-1.780=-0.009

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.410-0.406=0.004
σ0.147-0.139=0.008
min0.329-0.316=0.013
max0.672-0.652=0.020
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.880-0.884=-0.004
σ0.104-0.084=0.020
min0.802-0.829=-0.028
max1.060-1.033=0.027
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.535-0.534=0.002
σ0.051-0.051=-0.001
min0.498-0.479=0.019
max0.620-0.613=0.008
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.836-0.835=0.001
σ0.042-0.047=-0.005
min0.803-0.793=0.010
max0.901-0.915=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.116-964.114=0.002
σ0.035-0.033=0.002
min964.086-964.084=0.002
max964.173-964.169=0.004
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.800-0.844=-0.045
σ0.044-0.017=0.026
min0.745-0.815=-0.070
max0.861-0.861=-0.001
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.004-0.008=-0.004
min884.705-884.703=0.001
max884.715-884.723=-0.007
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.712-0.698=0.014
σ0.037-0.059=-0.022
min0.656-0.597=0.060
max0.741-0.739=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean3.480-4.242=-0.761
σ0.088-0.083=0.004
min3.328-4.123=-0.795
max3.767-4.625=-0.858
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean3.486-4.221=-0.735
σ0.083-0.061=0.022
min3.367-4.104=-0.737
max3.781-4.370=-0.590
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.730-0.735=-0.006
σ0.019-0.021=-0.002
min0.697-0.707=-0.009
max0.851-0.849=0.002
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.691-0.690=0.001
σ0.014-0.018=-0.004
min0.658-0.605=0.053
max0.760-0.761=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.352-296.290=0.062
σ0.235-0.236=-0.000
min296.089-296.022=0.067
max296.967-296.791=0.176
mean1909.000-1942.000=-33.000
σ0.000
min1909.000-1942.000=-33.000
max1909.000-1942.000=-33.000
mean0.584-0.574=0.010
σ0.051-0.034=0.017
min0.508-0.511=-0.003
max0.685-0.608=0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.701-284.696=0.005
σ0.025-0.036=-0.011
min284.679-284.652=0.027
max284.732-284.737=-0.005
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.393-0.402=-0.010
σ0.006-0.013=-0.007
min0.389-0.385=0.004
max0.403-0.421=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.080=0.001
σ0.111-0.113=-0.003
min1294.959-1294.962=-0.003
max1295.220-1295.222=-0.001
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean1.916-1.909=0.007
σ0.087-0.097=-0.010
min1.820-1.804=0.016
max2.025-1.994=0.030
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1539.181=0.003
σ6.863-6.861=0.002
min1535.936-1535.940=-0.004
max1551.457-1551.451=0.006
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean2.269-2.265=0.004
σ0.234-0.260=-0.025
min2.043-2.016=0.028
max2.563-2.577=-0.014
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.987=0.004
σ0.055-0.057=-0.002
min1856.941-1856.924=0.018
max1857.076-1857.055=0.021
mean1778.000-1788.200=-10.200
σ128.410-149.809=-21.399
min1650.000-1643.000=7.000
max1909.000-1942.000=-33.000
mean3.164-3.061=0.103
σ0.260-0.182=0.078
min2.938-2.808=0.130
max3.541-3.318=0.223

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.265=-0.058
σ0.323-0.276=0.048
min0.935-1.060=-0.125
max1.573-1.581=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.785=-0.000
σ581.212-581.212=0.000
min157.177-157.178=-0.000
max1319.603-1319.602=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.542-0.542=-0.000
σ0.559-0.565=-0.006
min0.259-0.258=0.001
max1.381-1.390=-0.009
policies=20
mean1572.088-1572.089=-0.001
σ0.356-0.358=-0.002
min1571.849-1571.848=0.000
max1572.618-1572.621=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean2.635-2.628=0.007
σ0.022-0.018=0.004
min2.613-2.611=0.002
max2.660-2.652=0.008
policies=200
mean15729.039-15729.016=0.024
σ0.129-0.131=-0.001
min15728.886-15728.866=0.020
max15729.202-15729.183=0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean26.597-26.464=0.133
σ0.034-0.018=0.015
min26.547-26.449=0.098
max26.620-26.490=0.130