Compare commits

Home / Compare ca9fd64f .. 1da64666

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.054-0.056=-0.001
min35.593-35.589=0.005
max35.771-35.775=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.085-0.086=-0.001
σ0.003-0.003=-0.000
min0.082-0.083=-0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.002
σ0.002-0.004=-0.002
min24.045-24.041=0.004
max24.052-24.055=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.068-0.064=0.004
σ0.003-0.005=-0.003
min0.066-0.061=0.005
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.491=-0.000
σ0.365-0.365=-0.000
min1755.917-1755.916=0.001
max1757.080-1757.078=0.002
mean1654.000-1651.250=2.750
σ641.406-645.108=-3.703
min630.000-648.000=-18.000
max2847.000-2839.000=8.000
mean2.365-2.331=0.033
σ0.113-0.062=0.050
min2.233-2.255=-0.022
max2.624-2.480=0.144

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.762=-0.000
σ0.056-0.043=0.013
min324.662-324.691=-0.029
max324.800-324.798=0.002
mean2847.000-2839.000=8.000
σ0.000
min2847.000-2839.000=8.000
max2847.000-2839.000=8.000
mean0.432-0.420=0.012
σ0.008-0.010=-0.003
min0.422-0.415=0.008
max0.440-0.438=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.330=-0.012
σ0.016-0.004=0.012
min1985.291-1985.325=-0.034
max1985.330-1985.334=-0.004
mean2847.000-2839.000=8.000
σ0.000
min2847.000-2839.000=8.000
max2847.000-2839.000=8.000
mean2.621-2.601=0.019
σ0.068-0.058=0.010
min2.551-2.522=0.029
max2.715-2.661=0.054
iters=5
new-facts=6402
prior-facts=1
mean4809.106-4809.024=0.082
σ7.628-7.706=-0.079
min4805.595-4804.974=0.621
max4822.749-4822.794=-0.045
mean2847.000-2839.000=8.000
σ0.000
min2847.000-2839.000=8.000
max2847.000-2839.000=8.000
mean8.935-8.763=0.172
σ0.456-0.818=-0.361
min8.367-7.684=0.683
max9.633-9.963=-0.331
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.630=-0.001
σ0.023-0.025=-0.002
min4996.598-4996.589=0.009
max4996.653-4996.651=0.002
mean3056.600-3048.400=8.200
σ226.085-188.558=37.526
min2847.000-2839.000=8.000
max3393.000-3320.000=73.000
mean8.751-8.628=0.123
σ0.170-0.132=0.038
min8.496-8.483=0.012
max8.958-8.788=0.171

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-1.002=-0.079
σ0.014-0.191=-0.177
min0.912-0.913=-0.002
max0.947-1.345=-0.398

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-463.215=-0.008
σ574.766-574.767=-0.001
min175.818-175.820=-0.002
max1325.356-1325.366=-0.010
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2839.000=8.000
σ0.000
min2847.000-2839.000=8.000
max2847.000-2839.000=8.000
mean0.423-0.432=-0.009
σ0.292-0.301=-0.009
min0.271-0.278=-0.008
max0.861-0.884=-0.023
policies=20
mean1758.519-1758.532=-0.012
σ0.350-0.351=-0.002
min1758.301-1758.292=0.009
max1759.040-1759.051=-0.011
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2839.000=8.000
σ0.000
min2847.000-2839.000=8.000
max2847.000-2839.000=8.000
mean2.780-2.781=-0.001
σ0.007-0.004=0.004
min2.771-2.778=-0.007
max2.788-2.786=0.002
policies=200
mean17592.188-17592.099=0.089
σ0.486-0.550=-0.064
min17591.867-17591.798=0.069
max17592.911-17592.923=-0.012
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2839.000=8.000
σ0.000
min2847.000-2839.000=8.000
max2847.000-2839.000=8.000
mean27.898-27.786=0.113
σ0.342-0.383=-0.041
min27.428-27.375=0.053
max28.189-28.227=-0.038