Compare commits

Home / Compare 151c8e0f .. f375f03c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.055-0.052=0.003
min35.586-35.592=-0.006
max35.772-35.765=0.007
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.002
min0.077-0.082=-0.005
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.003-0.003=-0.000
min24.041-24.043=-0.002
max24.050-24.053=-0.002
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.066-0.067=-0.001
σ0.004-0.002=0.002
min0.062-0.065=-0.003
max0.074-0.074=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.491=0.000
σ0.366-0.365=0.001
min1755.914-1755.915=-0.001
max1757.081-1757.080=0.002
mean1643.500-1630.200=13.300
σ642.307-594.267=48.041
min645.000-662.000=-17.000
max2822.000-2430.000=392.000
mean2.336-2.332=0.004
σ0.113-0.087=0.026
min2.071-2.214=-0.143
max2.669-2.575=0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.769-324.768=0.001
σ0.043-0.046=-0.003
min324.692-324.687=0.005
max324.798-324.800=-0.002
mean2822.000-2430.000=392.000
σ0.000
min2822.000-2430.000=392.000
max2822.000-2430.000=392.000
mean0.432-0.431=0.001
σ0.010-0.009=0.002
min0.424-0.424=-0.001
max0.446-0.444=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.318-1985.319=-0.002
σ0.011-0.016=-0.005
min1985.301-1985.293=0.008
max1985.327-1985.337=-0.009
mean2822.000-2430.000=392.000
σ0.000
min2822.000-2430.000=392.000
max2822.000-2430.000=392.000
mean2.660-2.630=0.029
σ0.127-0.132=-0.005
min2.513-2.548=-0.035
max2.815-2.862=-0.046
iters=5
new-facts=6402
prior-facts=1
mean4808.976-4808.965=0.011
σ7.737-7.728=0.009
min4805.072-4805.091=-0.019
max4822.809-4822.782=0.026
mean2822.000-2430.000=392.000
σ0.000
min2822.000-2430.000=392.000
max2822.000-2430.000=392.000
mean8.712-8.760=-0.048
σ0.484-0.161=0.324
min7.963-8.571=-0.608
max9.264-8.936=0.328
iters=5
new-facts=6402
prior-facts=6402
mean4996.554-4996.627=-0.073
σ0.154-0.021=0.133
min4996.280-4996.601=-0.321
max4996.644-4996.648=-0.005
mean3001.600-2922.000=79.600
σ259.533-336.093=-76.560
min2822.000-2430.000=392.000
max3408.000-3325.000=83.000
mean8.477-8.534=-0.057
σ0.057-0.071=-0.015
min8.422-8.487=-0.066
max8.561-8.653=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-1.711=-0.760
σ0.056-0.081=-0.025
min0.917-1.573=-0.656
max1.049-1.772=-0.723

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.217-463.201=0.016
σ574.770-574.764=0.006
min175.821-175.815=0.006
max1325.372-1325.347=0.024
mean86.250
σ8.500
min82.000
max99.000
mean2822.000-2430.000=392.000
σ0.000
min2822.000-2430.000=392.000
max2822.000-2430.000=392.000
mean0.466-0.539=-0.073
σ0.367-0.523=-0.156
min0.281-0.274=0.008
max1.016-1.324=-0.307
policies=20
mean1758.500-1758.483=0.017
σ0.341-0.355=-0.014
min1758.292-1758.250=0.041
max1759.008-1759.009=-0.001
mean820.000
σ0.000
min820.000
max820.000
mean2822.000-2430.000=392.000
σ0.000
min2822.000-2430.000=392.000
max2822.000-2430.000=392.000
mean2.781-2.711=0.070
σ0.015-0.014=0.001
min2.762-2.697=0.065
max2.795-2.724=0.071
policies=200
mean17592.118-17592.126=-0.007
σ0.571-0.462=0.109
min17591.804-17591.868=-0.064
max17592.974-17592.819=0.156
mean8200.000
σ0.000
min8200.000
max8200.000
mean2822.000-2430.000=392.000
σ0.000
min2822.000-2430.000=392.000
max2822.000-2430.000=392.000
mean27.919-27.509=0.410
σ0.318-0.120=0.199
min27.567-27.398=0.169
max28.247-27.665=0.583