Compare commits

Home / Compare 8d2fe315 .. dae739a2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.563=-0.002
σ0.048-0.044=0.003
min70.532-70.541=-0.009
max70.695-70.688=0.007
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.153-0.159=-0.006
σ0.004-0.005=-0.001
min0.148-0.149=-0.001
max0.157-0.166=-0.009
cache=y
dps=1
iters=10
policies=100
mean21.291-21.292=-0.001
σ0.013-0.011=0.001
min21.282-21.285=-0.003
max21.326-21.324=0.003
mean413.000-411.700=1.300
σ0.000-0.483=-0.483
min413.000-411.000=2.000
max413.000-412.000=1.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.063=-0.001
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.569=-0.001
σ0.359-0.361=-0.002
min1752.999-1752.999=0.000
max1754.155-1754.151=0.004
mean1654.450-1666.800=-12.350
σ647.363-643.748=3.615
min642.000-687.000=-45.000
max2897.000-2750.000=147.000
mean2.817-2.808=0.009
σ0.150-0.141=0.009
min2.462-2.398=0.064
max3.008-3.006=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-272.014=0.002
σ0.007-0.010=-0.003
min272.008-272.001=0.007
max272.026-272.027=-0.002
mean2897.000-2750.000=147.000
σ0.000
min2897.000-2750.000=147.000
max2897.000-2750.000=147.000
mean0.389-0.396=-0.007
σ0.007-0.016=-0.008
min0.381-0.378=0.003
max0.397-0.419=-0.023
iters=5
new-facts=1
prior-facts=6402
mean1932.434-1932.440=-0.006
σ0.013-0.018=-0.005
min1932.415-1932.423=-0.008
max1932.450-1932.466=-0.017
mean2897.000-2750.000=147.000
σ0.000
min2897.000-2750.000=147.000
max2897.000-2750.000=147.000
mean3.012-2.883=0.129
σ0.096-0.179=-0.083
min2.880-2.569=0.311
max3.117-3.005=0.112
iters=5
new-facts=6402
prior-facts=1
mean4753.056-4753.108=-0.051
σ0.939-0.937=0.001
min4752.144-4752.237=-0.094
max4754.643-4754.710=-0.068
mean2897.000-2750.000=147.000
σ0.000
min2897.000-2750.000=147.000
max2897.000-2750.000=147.000
mean8.458-8.173=0.285
σ0.546-0.411=0.135
min7.606-7.739=-0.133
max8.977-8.639=0.338
iters=5
new-facts=6402
prior-facts=6402
mean4943.494-4943.562=-0.068
σ0.200-0.152=0.049
min4943.270-4943.292=-0.022
max4943.660-4943.645=0.015
mean3069.800-3039.400=30.400
σ180.124-342.720=-162.596
min2897.000-2750.000=147.000
max3327.000-3548.000=-221.000
mean8.692-8.507=0.185
σ0.348-0.378=-0.030
min8.381-8.238=0.144
max9.259-9.172=0.087

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-0.994=0.032
σ0.139-0.141=-0.002
min0.934-0.927=0.007
max1.254-1.246=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.090=-0.010
σ575.916-575.941=-0.025
min185.112-185.109=0.003
max1336.954-1337.002=-0.048
mean88.250
σ8.500
min84.000
max101.000
mean2897.000-2750.000=147.000
σ0.000
min2897.000-2750.000=147.000
max2897.000-2750.000=147.000
mean0.488-0.544=-0.056
σ0.377-0.507=-0.130
min0.296-0.286=0.010
max1.054-1.305=-0.251
policies=20
mean1851.459-1851.429=0.030
σ0.363-0.375=-0.012
min1851.182-1851.180=0.002
max1851.988-1851.984=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2897.000-2750.000=147.000
σ0.000
min2897.000-2750.000=147.000
max2897.000-2750.000=147.000
mean2.935-2.879=0.056
σ0.006-0.016=-0.010
min2.928-2.865=0.064
max2.942-2.900=0.042
policies=200
mean18521.239-18521.152=0.087
σ0.398-0.509=-0.111
min18520.958-18520.862=0.096
max18521.830-18521.914=-0.084
mean8400.000
σ0.000
min8400.000
max8400.000
mean2897.000-2750.000=147.000
σ0.000
min2897.000-2750.000=147.000
max2897.000-2750.000=147.000
mean29.256-28.900=0.356
σ0.592-0.174=0.418
min28.733-28.724=0.009
max29.962-29.136=0.826