Compare commits

Home / Compare cd55a352 .. ca30684b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.016=-0.003
σ0.369-0.369=0.000
min53.879-53.868=0.010
max55.063-55.065=-0.002
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.135-0.138=-0.004
σ0.005-0.005=0.000
min0.129-0.132=-0.003
max0.142-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.007-0.005=0.002
min43.312-43.314=-0.001
max43.337-43.329=0.007
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.117-0.122=-0.005
σ0.003-0.004=-0.001
min0.115-0.118=-0.004
max0.122-0.130=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.306=0.000
σ1.165-1.218=-0.054
min1005.774-1005.765=0.009
max1011.178-1011.405=-0.227
mean1048.400-1051.050=-2.650
σ313.630-313.560=0.070
min598.000-601.000=-3.000
max1646.000-1649.000=-3.000
mean1.561-1.707=-0.147
σ0.079-0.078=0.002
min1.478-1.604=-0.126
max1.786-1.941=-0.155

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.416
σ0.136
min0.329
max0.657
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.895
σ0.114
min0.828
max1.097
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.575
σ0.074
min0.497
max0.673
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.861
σ0.045
min0.822
max0.930

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.023
min964.092
max964.151
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.826
σ0.031
min0.795
max0.864
name=cdr_enhanced_4k_loc.art
mean884.713
σ0.006
min884.705
max884.722
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.720
σ0.014
min0.704
max0.738

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1646.000
σ0.000
min1646.000
max1646.000
mean3.504
σ0.086
min3.368
max3.850
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1646.000
σ0.000
min1646.000
max1646.000
mean3.660
σ0.332
min3.364
max4.666
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.739
σ0.029
min0.587
max0.880
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.696
σ0.029
min0.516
max0.785

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.284-296.152=0.132
σ0.257-0.243=0.014
min296.071-295.964=0.107
max296.967-296.827=0.140
mean1905.000-1901.000=4.000
σ0.000
min1905.000-1901.000=4.000
max1905.000-1901.000=4.000
mean0.564-0.562=0.002
σ0.043-0.035=0.008
min0.502-0.504=-0.002
max0.610-0.600=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.676-284.684=-0.008
σ0.040-0.037=0.003
min284.639-284.633=0.006
max284.735-284.722=0.013
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.404-0.387=0.018
σ0.002-0.009=-0.007
min0.402-0.379=0.023
max0.408-0.397=0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.075-1295.078=-0.003
σ0.102-0.102=0.000
min1294.961-1294.962=-0.001
max1295.198-1295.217=-0.019
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean1.926-1.881=0.044
σ0.094-0.093=0.001
min1.818-1.780=0.038
max2.034-2.001=0.034
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1539.195=-0.009
σ6.857-6.831=0.026
min1535.917-1535.908=0.009
max1551.450-1551.409=0.040
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean2.267-2.220=0.047
σ0.261-0.173=0.089
min2.060-2.075=-0.015
max2.683-2.472=0.211
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.987=0.004
σ0.054-0.054=-0.001
min1856.938-1856.933=0.005
max1857.068-1857.068=0.000
mean1775.800-1771.800=4.000
σ128.280-123.512=4.768
min1646.000-1649.000=-3.000
max1905.000-1901.000=4.000
mean3.003-3.037=-0.034
σ0.301-0.366=-0.065
min2.683-2.688=-0.006
max3.486-3.631=-0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.171=-0.013
σ0.304-0.254=0.050
min0.925-0.928=-0.002
max1.644-1.575=0.068

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.804=-0.020
σ581.213-581.228=-0.015
min157.174-157.182=-0.008
max1319.603-1319.645=-0.043
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean0.542-0.552=-0.010
σ0.564-0.559=0.005
min0.259-0.269=-0.010
max1.388-1.390=-0.002
policies=20
mean1572.086-1572.133=-0.047
σ0.355-0.368=-0.014
min1571.850-1571.931=-0.081
max1572.614-1572.685=-0.071
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean2.624-2.687=-0.063
σ0.013-0.021=-0.009
min2.606-2.655=-0.049
max2.634-2.701=-0.067
policies=200
mean15729.025-15728.905=0.121
σ0.074-0.114=-0.039
min15728.930-15728.748=0.182
max15729.106-15729.009=0.097
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1649.000=-3.000
σ0.000
min1646.000-1649.000=-3.000
max1646.000-1649.000=-3.000
mean26.612-27.170=-0.558
σ0.176-0.086=0.090
min26.474-27.083=-0.609
max26.855-27.285=-0.430