Compare commits

Home / Compare 3b823d41 .. 7dc09f4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.055-0.055=0.000
min35.587-35.588=-0.001
max35.774-35.772=0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.084-0.085=-0.001
σ0.005-0.003=0.002
min0.076-0.083=-0.007
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.000
σ0.003-0.003=0.001
min24.042-24.044=-0.002
max24.052-24.052=-0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.068-0.068=-0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.077-0.076=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.490=0.001
σ0.366-0.365=0.001
min1755.915-1755.916=-0.001
max1757.080-1757.083=-0.002
mean1643.050-1649.200=-6.150
σ603.528-641.720=-38.192
min646.000-651.000=-5.000
max2460.000-2831.000=-371.000
mean2.332-2.336=-0.005
σ0.100-0.059=0.041
min2.157-2.251=-0.095
max2.621-2.431=0.190

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.767=-0.001
σ0.050-0.065=-0.016
min324.678-324.651=0.027
max324.794-324.803=-0.009
mean2460.000-2831.000=-371.000
σ0.000
min2460.000-2831.000=-371.000
max2460.000-2831.000=-371.000
mean0.433-0.435=-0.001
σ0.011-0.018=-0.008
min0.422-0.419=0.003
max0.445-0.460=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.324-1985.329=-0.005
σ0.011-0.012=-0.001
min1985.309-1985.308=0.001
max1985.335-1985.338=-0.003
mean2460.000-2831.000=-371.000
σ0.000
min2460.000-2831.000=-371.000
max2460.000-2831.000=-371.000
mean2.651-2.680=-0.029
σ0.195-0.156=0.039
min2.499-2.570=-0.071
max2.987-2.935=0.052
iters=5
new-facts=6402
prior-facts=1
mean4809.079-4809.081=-0.003
σ7.731-7.720=0.011
min4805.613-4805.577=0.036
max4822.908-4822.891=0.017
mean2460.000-2831.000=-371.000
σ0.000
min2460.000-2831.000=-371.000
max2460.000-2831.000=-371.000
mean8.780-8.780=0.000
σ0.624-0.576=0.049
min7.683-7.763=-0.080
max9.246-9.182=0.064
iters=5
new-facts=6402
prior-facts=6402
mean4996.551-4996.555=-0.004
σ0.137-0.171=-0.034
min4996.308-4996.252=0.056
max4996.632-4996.649=-0.017
mean2951.600-3061.000=-109.400
σ441.715-302.388=139.327
min2460.000-2831.000=-371.000
max3546.000-3529.000=17.000
mean8.489-8.522=-0.033
σ0.119-0.140=-0.020
min8.415-8.425=-0.010
max8.700-8.767=-0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.655-0.981=0.674
σ0.244-0.137=0.107
min1.253-0.916=0.337
max1.865-1.226=0.639

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.200-463.215=-0.015
σ574.763-574.770=-0.007
min175.811-175.817=-0.007
max1325.345-1325.370=-0.025
mean86.250
σ8.500
min82.000
max99.000
mean2460.000-2831.000=-371.000
σ0.000
min2460.000-2831.000=-371.000
max2460.000-2831.000=-371.000
mean0.518-0.436=0.082
σ0.490-0.301=0.189
min0.272-0.285=-0.013
max1.253-0.888=0.365
policies=20
mean1758.492-1758.532=-0.040
σ0.367-0.349=0.018
min1758.236-1758.289=-0.054
max1759.033-1759.048=-0.015
mean820.000
σ0.000
min820.000
max820.000
mean2460.000-2831.000=-371.000
σ0.000
min2460.000-2831.000=-371.000
max2460.000-2831.000=-371.000
mean2.759-2.800=-0.041
σ0.038-0.015=0.024
min2.726-2.790=-0.065
max2.813-2.821=-0.008
policies=200
mean17592.026-17592.177=-0.151
σ0.445-0.431=0.014
min17591.669-17591.923=-0.254
max17592.675-17592.820=-0.145
mean8200.000
σ0.000
min8200.000
max8200.000
mean2460.000-2831.000=-371.000
σ0.000
min2460.000-2831.000=-371.000
max2460.000-2831.000=-371.000
mean27.526-27.874=-0.347
σ0.180-0.421=-0.240
min27.348-27.454=-0.105
max27.733-28.280=-0.548