Compare commits

Home / Compare 126e5daa .. 146fad44

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.000
σ0.053-0.055=-0.002
min35.239-35.230=0.009
max35.415-35.418=-0.004
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.085-0.083=0.002
σ0.003-0.004=-0.000
min0.082-0.077=0.005
max0.091-0.088=0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.002
σ0.002-0.003=-0.001
min23.768-23.764=0.003
max23.774-23.774=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.068-0.067=0.002
σ0.003-0.005=-0.002
min0.066-0.061=0.005
max0.074-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=-0.001
σ0.366-0.366=0.000
min1755.912-1755.909=0.003
max1757.075-1757.079=-0.004
mean1644.850-1646.300=-1.450
σ642.027-639.692=2.334
min667.000-623.000=44.000
max2724.000-2823.000=-99.000
mean2.375-2.330=0.045
σ0.119-0.067=0.051
min2.192-2.238=-0.046
max2.581-2.468=0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.699-324.682=0.016
σ0.056-0.051=0.005
min324.600-324.593=0.008
max324.737-324.716=0.020
mean2724.000-2823.000=-99.000
σ0.000
min2724.000-2823.000=-99.000
max2724.000-2823.000=-99.000
mean0.424-0.438=-0.014
σ0.002-0.017=-0.015
min0.422-0.425=-0.002
max0.426-0.466=-0.039
iters=5
new-facts=1
prior-facts=6402
mean1985.266-1985.266=-0.000
σ0.014-0.010=0.004
min1985.242-1985.250=-0.008
max1985.274-1985.274=0.000
mean2724.000-2823.000=-99.000
σ0.000
min2724.000-2823.000=-99.000
max2724.000-2823.000=-99.000
mean2.610-2.687=-0.077
σ0.084-0.163=-0.079
min2.533-2.510=0.023
max2.727-2.890=-0.163
iters=5
new-facts=6402
prior-facts=1
mean4808.797-4808.672=0.125
σ7.735-7.216=0.519
min4804.797-4805.422=-0.625
max4822.622-4821.581=1.041
mean2724.000-2823.000=-99.000
σ0.000
min2724.000-2823.000=-99.000
max2724.000-2823.000=-99.000
mean8.810-9.145=-0.335
σ0.612-0.200=0.413
min7.743-8.977=-1.234
max9.263-9.469=-0.206
iters=5
new-facts=6402
prior-facts=6402
mean4996.393-4996.467=-0.073
σ0.153-0.018=0.135
min4996.121-4996.446=-0.325
max4996.482-4996.489=-0.007
mean3017.600-3029.400=-11.800
σ345.238-281.789=63.449
min2724.000-2823.000=-99.000
max3528.000-3471.000=57.000
mean8.504-8.507=-0.003
σ0.119-0.127=-0.008
min8.431-8.359=0.073
max8.714-8.699=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-0.973=-0.028
σ0.053-0.067=-0.014
min0.911-0.916=-0.005
max1.038-1.052=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.963-462.972=-0.009
σ574.281-574.256=0.025
min175.818-175.836=-0.018
max1324.384-1324.355=0.029
mean86.250
σ8.500
min82.000
max99.000
mean2724.000-2823.000=-99.000
σ0.000
min2724.000-2823.000=-99.000
max2724.000-2823.000=-99.000
mean0.541-0.431=0.110
σ0.537-0.298=0.239
min0.270-0.278=-0.008
max1.347-0.879=0.468
policies=20
mean1758.530-1758.718=-0.188
σ0.343-0.342=0.001
min1758.298-1758.487=-0.190
max1759.037-1759.225=-0.187
mean820.000
σ0.000
min820.000
max820.000
mean2724.000-2823.000=-99.000
σ0.000
min2724.000-2823.000=-99.000
max2724.000-2823.000=-99.000
mean2.712-2.799=-0.087
σ0.017-0.004=0.014
min2.694-2.794=-0.100
max2.736-2.801=-0.066
policies=200
mean17592.502-17593.366=-0.864
σ0.460-0.723=-0.263
min17592.243-17592.370=-0.127
max17593.191-17593.930=-0.739
mean8200.000
σ0.000
min8200.000
max8200.000
mean2724.000-2823.000=-99.000
σ0.000
min2724.000-2823.000=-99.000
max2724.000-2823.000=-99.000
mean27.403-27.935=-0.532
σ0.115-0.353=-0.238
min27.278-27.588=-0.310
max27.526-28.350=-0.824