Compare commits

Home / Compare 8d84e1be .. 891bc4ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.974=-0.000
σ0.106-0.107=-0.000
min35.926-35.926=0.000
max36.276-36.276=-0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.077-0.077=-0.000
σ0.003-0.004=-0.000
min0.074-0.074=-0.000
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.003-0.004=-0.001
min26.202-26.202=0.001
max26.212-26.216=-0.004
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.059-0.061=-0.002
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.068-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.380-1758.375=0.005
σ0.369-0.373=-0.003
min1757.801-1757.800=0.001
max1758.959-1758.978=-0.019
mean1656.450-1660.800=-4.350
σ623.047-623.906=-0.859
min685.000-689.000=-4.000
max2761.000-2770.000=-9.000
mean2.325-2.359=-0.034
σ0.096-0.093=0.003
min2.185-2.192=-0.007
max2.554-2.591=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.558-279.557=0.001
σ0.008-0.009=-0.001
min279.550-279.547=0.002
max279.569-279.565=0.004
mean2761.000-2770.000=-9.000
σ0.000
min2761.000-2770.000=-9.000
max2761.000-2770.000=-9.000
mean0.416-0.410=0.006
σ0.013-0.007=0.007
min0.407-0.403=0.004
max0.439-0.418=0.021
iters=5
new-facts=1
prior-facts=6402
mean2178.484-2178.476=0.007
σ0.014-0.014=0.000
min2178.463-2178.460=0.003
max2178.498-2178.491=0.007
mean2761.000-2770.000=-9.000
σ0.000
min2761.000-2770.000=-9.000
max2761.000-2770.000=-9.000
mean3.296-3.405=-0.109
σ0.216-0.098=0.118
min3.053-3.264=-0.211
max3.586-3.535=0.051
iters=5
new-facts=6402
prior-facts=1
mean5056.420-5056.338=0.081
σ1.018-0.768=0.250
min5055.802-5055.809=-0.008
max5058.231-5057.663=0.568
mean2761.000-2770.000=-9.000
σ0.000
min2761.000-2770.000=-9.000
max2761.000-2770.000=-9.000
mean9.151-9.073=0.079
σ0.596-0.802=-0.206
min8.196-8.118=0.078
max9.806-9.994=-0.188
iters=5
new-facts=6402
prior-facts=6402
mean5193.734-5193.731=0.003
σ0.212-0.211=0.001
min5193.382-5193.380=0.002
max5193.908-5193.903=0.005
mean3270.400-3294.200=-23.800
σ349.894-383.514=-33.620
min2761.000-2770.000=-9.000
max3688.000-3660.000=28.000
mean8.881-9.026=-0.146
σ0.224-0.386=-0.162
min8.675-8.636=0.039
max9.199-9.651=-0.453

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.964-0.974=-0.011
σ0.057-0.061=-0.003
min0.928-0.934=-0.007
max1.064-1.080=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.535-465.534=0.001
σ572.658-572.662=-0.004
min179.202-179.200=0.002
max1324.522-1324.527=-0.005
mean79.500
σ7.000
min76.000
max90.000
mean2761.000-2770.000=-9.000
σ0.000
min2761.000-2770.000=-9.000
max2761.000-2770.000=-9.000
mean0.465-0.483=-0.018
σ0.366-0.404=-0.038
min0.278-0.279=-0.002
max1.014-1.088=-0.075
policies=20
mean1792.299-1792.278=0.021
σ0.343-0.330=0.013
min1792.106-1792.090=0.017
max1792.812-1792.771=0.041
mean760.000
σ0.000
min760.000
max760.000
mean2761.000-2770.000=-9.000
σ0.000
min2761.000-2770.000=-9.000
max2761.000-2770.000=-9.000
mean2.804-2.795=0.009
σ0.008-0.007=0.001
min2.796-2.789=0.007
max2.815-2.805=0.010
policies=200
mean17929.584-17929.567=0.017
σ0.482-0.518=-0.036
min17929.303-17929.273=0.031
max17930.304-17930.340=-0.036
mean7600.000
σ0.000
min7600.000
max7600.000
mean2761.000-2770.000=-9.000
σ0.000
min2761.000-2770.000=-9.000
max2761.000-2770.000=-9.000
mean28.212-28.233=-0.021
σ0.069-0.117=-0.048
min28.145-28.118=0.026
max28.283-28.364=-0.081