Compare commits

Home / Compare a8bb1d51 .. 3f6c8bfc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.265=-0.001
σ0.053-0.054=-0.001
min35.239-35.239=-0.000
max35.413-35.417=-0.004
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.085-0.086=-0.001
σ0.004-0.004=-0.000
min0.082-0.082=-0.000
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.001
σ0.003-0.003=0.000
min23.765-23.765=-0.000
max23.775-23.774=0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.068-0.069=-0.000
σ0.003-0.003=-0.000
min0.066-0.066=0.000
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.471-1756.487=-0.016
σ0.366-0.366=-0.000
min1755.894-1755.910=-0.017
max1757.061-1757.079=-0.018
mean1651.800-1629.350=22.450
σ642.928-593.864=49.064
min624.000-652.000=-28.000
max2838.000-2429.000=409.000
mean2.325-2.319=0.006
σ0.087-0.080=0.007
min2.142-2.161=-0.019
max2.516-2.464=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.691-324.686=0.005
σ0.056-0.043=0.014
min324.591-324.611=-0.020
max324.723-324.717=0.006
mean2838.000-2429.000=409.000
σ0.000
min2838.000-2429.000=409.000
max2838.000-2429.000=409.000
mean0.426-0.432=-0.006
σ0.005-0.009=-0.004
min0.422-0.426=-0.004
max0.434-0.445=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.250-1985.267=-0.017
σ0.011-0.009=0.002
min1985.236-1985.262=-0.026
max1985.262-1985.283=-0.021
mean2838.000-2429.000=409.000
σ0.000
min2838.000-2429.000=409.000
max2838.000-2429.000=409.000
mean2.580-2.650=-0.070
σ0.060-0.068=-0.008
min2.526-2.573=-0.047
max2.650-2.734=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4808.765-4808.796=-0.031
σ7.755-7.826=-0.071
min4804.803-4804.793=0.010
max4822.627-4822.785=-0.158
mean2838.000-2429.000=409.000
σ0.000
min2838.000-2429.000=409.000
max2838.000-2429.000=409.000
mean8.662-9.110=-0.448
σ0.630-0.434=0.196
min7.637-8.656=-1.018
max9.177-9.796=-0.620
iters=5
new-facts=6402
prior-facts=6402
mean4996.457-4996.469=-0.012
σ0.020-0.018=0.002
min4996.440-4996.449=-0.008
max4996.481-4996.486=-0.005
mean3058.200-2997.200=61.000
σ205.806-369.795=-163.989
min2838.000-2524.000=314.000
max3359.000-3353.000=6.000
mean8.653-8.725=-0.072
σ0.160-0.223=-0.063
min8.471-8.471=-0.000
max8.871-9.068=-0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.969-1.584=-0.615
σ0.071-0.173=-0.102
min0.898-1.334=-0.436
max1.046-1.774=-0.728

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.948-462.950=-0.002
σ574.257-574.249=0.008
min175.815-175.820=-0.005
max1324.333-1324.323=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2429.000=409.000
σ0.000
min2838.000-2429.000=409.000
max2838.000-2429.000=409.000
mean0.425-0.557=-0.132
σ0.287-0.564=-0.277
min0.280-0.271=0.009
max0.855-1.402=-0.547
policies=20
mean1758.486-1758.522=-0.036
σ0.344-0.332=0.012
min1758.256-1758.299=-0.043
max1758.997-1759.014=-0.017
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2429.000=409.000
σ0.000
min2838.000-2429.000=409.000
max2838.000-2429.000=409.000
mean2.789-2.699=0.090
σ0.012-0.018=-0.005
min2.774-2.682=0.092
max2.804-2.721=0.083
policies=200
mean17591.160-17592.497=-1.337
σ0.631-0.500=0.131
min17590.336-17592.231=-1.895
max17591.707-17593.246=-1.539
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2429.000=409.000
σ0.000
min2838.000-2429.000=409.000
max2838.000-2429.000=409.000
mean27.895-27.396=0.499
σ0.387-0.160=0.227
min27.512-27.242=0.270
max28.343-27.583=0.760