Compare commits

Home / Compare efb87430 .. 39e74fec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.002
σ0.054-0.056=-0.002
min35.237-35.229=0.008
max35.415-35.421=-0.005
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.081-0.086=-0.004
σ0.005-0.003=0.002
min0.076-0.084=-0.007
max0.089-0.093=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.002-0.004=-0.002
min23.765-23.763=0.002
max23.774-23.777=-0.003
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.069-0.068=0.001
σ0.003-0.002=0.001
min0.067-0.067=0.000
max0.075-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.001
σ0.365-0.363=0.002
min1755.912-1755.913=-0.001
max1757.077-1757.070=0.007
mean1651.000-1652.900=-1.900
σ640.585-644.388=-3.803
min628.000-626.000=2.000
max2840.000-2842.000=-2.000
mean2.329-2.332=-0.003
σ0.059-0.092=-0.033
min2.256-2.126=0.130
max2.433-2.508=-0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.705=0.001
σ0.048-0.056=-0.009
min324.621-324.605=0.017
max324.740-324.740=-0.001
mean2840.000-2842.000=-2.000
σ0.000
min2840.000-2842.000=-2.000
max2840.000-2842.000=-2.000
mean0.426-0.426=-0.000
σ0.006-0.012=-0.006
min0.422-0.420=0.003
max0.436-0.447=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.267=0.003
σ0.007-0.011=-0.004
min1985.259-1985.248=0.012
max1985.277-1985.277=0.000
mean2840.000-2842.000=-2.000
σ0.000
min2840.000-2842.000=-2.000
max2840.000-2842.000=-2.000
mean2.596-2.629=-0.033
σ0.058-0.211=-0.153
min2.543-2.437=0.106
max2.669-2.965=-0.296
iters=5
new-facts=6402
prior-facts=1
mean4808.911-4808.890=0.020
σ7.708-7.637=0.071
min4805.357-4805.448=-0.092
max4822.698-4822.552=0.146
mean2840.000-2842.000=-2.000
σ0.000
min2840.000-2842.000=-2.000
max2840.000-2842.000=-2.000
mean8.833-9.033=-0.201
σ0.627-0.235=0.392
min7.771-8.645=-0.873
max9.353-9.269=0.083
iters=5
new-facts=6402
prior-facts=6402
mean4996.463-4996.325=0.138
σ0.021-0.182=-0.160
min4996.440-4996.124=0.316
max4996.482-4996.481=0.001
mean3054.600-3064.600=-10.000
σ201.676-297.990=-96.313
min2840.000-2842.000=-2.000
max3350.000-3528.000=-178.000
mean8.706-8.425=0.281
σ0.237-0.173=0.064
min8.475-8.164=0.312
max9.071-8.651=0.420

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-0.918=0.089
σ0.136-0.011=0.125
min0.916-0.912=0.004
max1.228-0.937=0.290

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.969-462.968=0.001
σ574.253-574.248=0.004
min175.836-175.836=-0.000
max1324.348-1324.340=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2842.000=-2.000
σ0.000
min2840.000-2842.000=-2.000
max2840.000-2842.000=-2.000
mean0.472-0.430=0.042
σ0.382-0.306=0.075
min0.279-0.262=0.017
max1.045-0.889=0.156
policies=20
mean1758.707-1758.708=-0.002
σ0.343-0.360=-0.018
min1758.480-1758.487=-0.006
max1759.216-1759.245=-0.030
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2842.000=-2.000
σ0.000
min2840.000-2842.000=-2.000
max2840.000-2842.000=-2.000
mean2.790-2.779=0.011
σ0.015-0.003=0.012
min2.779-2.776=0.003
max2.812-2.783=0.029
policies=200
mean17593.384-17593.309=0.075
σ0.705-0.633=0.073
min17592.409-17592.544=-0.135
max17593.926-17593.908=0.018
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2842.000=-2.000
σ0.000
min2840.000-2842.000=-2.000
max2840.000-2842.000=-2.000
mean27.903-27.786=0.117
σ0.365-0.374=-0.009
min27.543-27.378=0.165
max28.348-28.154=0.194