Compare commits

Home / Compare afae6508 .. 85388e9e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728-36.728=0.001
σ0.846-0.615=0.231
min35.940-35.927=0.013
max38.451-37.218=1.233
mean3781.000-4097.000=-316.000
σ0.000
min3781.000-4097.000=-316.000
max3781.000-4097.000=-316.000
mean0.076-0.074=0.002
σ0.002-0.001=0.001
min0.074-0.071=0.003
max0.080-0.076=0.004
cache=y
dps=1
iters=10
policies=100
mean26.711-26.711=-0.000
σ0.648-0.646=0.001
min26.208-26.204=0.004
max27.470-27.466=0.004
mean3781.000-4097.000=-316.000
σ0.000
min3781.000-4097.000=-316.000
max3781.000-4097.000=-316.000
mean0.057-0.060=-0.003
σ0.001-0.001=0.000
min0.055-0.059=-0.004
max0.058-0.061=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.369=-0.000
σ0.373-0.374=-0.000
min1755.793-1755.789=0.004
max1756.960-1756.970=-0.009
mean1636.400-1665.600=-29.200
σ620.978-632.275=-11.298
min632.000-686.000=-54.000
max2836.000-2618.000=218.000
mean2.276-2.297=-0.021
σ0.147-0.146=0.000
min2.130-2.175=-0.046
max2.792-2.807=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.696=0.000
σ0.012-0.014=-0.002
min278.687-278.681=0.006
max278.716
mean2836.000-2618.000=218.000
σ0.000
min2836.000-2618.000=218.000
max2836.000-2618.000=218.000
mean0.418-0.417=0.001
σ0.001-0.001=0.000
min0.416-0.416=-0.000
max0.419-0.418=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.855-2268.867=-0.012
σ0.019-0.013=0.006
min2268.829-2268.844=-0.015
max2268.872-2268.878=-0.006
mean2836.000-2618.000=218.000
σ0.000
min2836.000-2618.000=218.000
max2836.000-2618.000=218.000
mean3.108-3.127=-0.019
σ0.112-0.173=-0.061
min2.916-2.866=0.050
max3.185-3.307=-0.122
iters=5
new-facts=6402
prior-facts=1
mean4952.247-4952.367=-0.119
σ0.871-0.907=-0.036
min4951.434-4951.799=-0.364
max4953.732-4953.980=-0.248
mean2836.000-2618.000=218.000
σ0.000
min2836.000-2618.000=218.000
max2836.000-2618.000=218.000
mean7.757-8.012=-0.255
σ0.239-0.442=-0.202
min7.561-7.621=-0.060
max8.147-8.766=-0.619
iters=5
new-facts=6402
prior-facts=6402
mean5167.069-5167.072=-0.003
σ0.012-0.011=0.002
min5167.054-5167.060=-0.006
max5167.088-5167.089=-0.001
mean3370.600-3422.000=-51.400
σ399.813-463.099=-63.286
min2983.000-2882.000=101.000
max3781.000-4097.000=-316.000
mean9.312-9.128=0.185
σ0.472-0.098=0.373
min8.484-9.027=-0.543
max9.622-9.264=0.359

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.598-1.038=0.560
σ0.338-0.139=0.199
min1.210-0.945=0.265
max1.899-1.265=0.634

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.256=0.003
σ572.608-572.608=0.000
min173.951-173.949=0.002
max1319.172-1319.168=0.004
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.543-0.554=-0.011
σ0.540-0.560=-0.020
min0.269-0.272=-0.002
max1.353-1.394=-0.041
policies=20
mean1740.050-1740.030=0.020
σ0.331-0.341=-0.010
min1739.809-1739.779=0.030
max1740.536-1740.530=0.007
mean760.000
σ0.000
min760.000
max760.000
mean445.250-447.500=-2.250
σ10.178-9.950=0.228
min435.000-437.000=-2.000
max454.000-456.000=-2.000
mean2.655-2.673=-0.018
σ0.004-0.015=-0.011
min2.649-2.658=-0.009
max2.659-2.695=-0.036
policies=200
mean17409.704-17409.718=-0.014
σ0.070-0.153=-0.083
min17409.629-17409.562=0.066
max17409.797-17409.879=-0.082
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.750-493.750=-3.000
σ3.775
min486.000-489.000=-3.000
max495.000-498.000=-3.000
mean26.856-26.993=-0.136
σ0.086-0.077=0.009
min26.742-26.922=-0.180
max26.947-27.062=-0.115