Compare commits

Home / Compare a1e482b8 .. 376c56c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.619=-0.002
σ0.055-0.055=-0.000
min35.586-35.587=-0.001
max35.773-35.775=-0.003
mean410.000-415.000=-5.000
σ0.000
min410.000-415.000=-5.000
max410.000-415.000=-5.000
mean0.085-0.085=0.000
σ0.003-0.003=-0.000
min0.083-0.082=0.001
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.000
σ0.002-0.003=-0.001
min24.043-24.041=0.001
max24.051-24.052=-0.001
mean410.000-415.700=-5.700
σ0.000-0.483=-0.483
min410.000-415.000=-5.000
max410.000-416.000=-6.000
mean0.068-0.068=0.000
σ0.003-0.004=-0.000
min0.066-0.066=0.000
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=0.000
σ0.365-0.364=0.000
min1755.916-1755.916=-0.000
max1757.077-1757.085=-0.008
mean1648.000-1649.900=-1.900
σ643.522-641.396=2.126
min627.000-633.000=-6.000
max2833.000-2829.000=4.000
mean2.342-2.324=0.019
σ0.084-0.077=0.007
min2.257-2.199=0.057
max2.512-2.454=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.758-324.767=-0.009
σ0.055-0.046=0.010
min324.660-324.686=-0.026
max324.791-324.797=-0.006
mean2833.000-2829.000=4.000
σ0.000
min2833.000-2829.000=4.000
max2833.000-2829.000=4.000
mean0.426-0.431=-0.005
σ0.008-0.009=-0.002
min0.421-0.424=-0.003
max0.440-0.442=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.330-1985.321=0.009
σ0.006-0.008=-0.002
min1985.322-1985.309=0.013
max1985.336-1985.330=0.007
mean2833.000-2829.000=4.000
σ0.000
min2833.000-2829.000=4.000
max2833.000-2829.000=4.000
mean2.602-2.757=-0.155
σ0.066-0.108=-0.042
min2.549-2.591=-0.041
max2.687-2.862=-0.175
iters=5
new-facts=6402
prior-facts=1
mean4809.097-4808.858=0.239
σ7.681-7.128=0.553
min4805.602-4805.636=-0.033
max4822.837-4821.609=1.228
mean2833.000-2829.000=4.000
σ0.000
min2833.000-2829.000=4.000
max2833.000-2829.000=4.000
mean8.967-8.716=0.251
σ0.151-0.269=-0.118
min8.824-8.258=0.566
max9.181-8.915=0.265
iters=5
new-facts=6402
prior-facts=6402
mean4996.630-4996.492=0.137
σ0.017-0.328=-0.310
min4996.611-4995.907=0.704
max4996.652-4996.656=-0.005
mean3045.000-3084.200=-39.200
σ197.119-259.030=-61.911
min2833.000-2829.000=4.000
max3333.000-3350.000=-17.000
mean8.682-9.161=-0.478
σ0.231-0.329=-0.098
min8.473-8.609=-0.136
max9.039-9.473=-0.434

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-1.013=-0.038
σ0.068-0.203=-0.135
min0.916-0.913=0.003
max1.058-1.376=-0.318

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.214=-0.009
σ574.767-574.770=-0.003
min175.815-175.813=0.002
max1325.356-1325.370=-0.014
mean86.250
σ8.500
min82.000
max99.000
mean2833.000-2829.000=4.000
σ0.000
min2833.000-2829.000=4.000
max2833.000-2829.000=4.000
mean0.432-0.471=-0.039
σ0.298-0.375=-0.077
min0.283-0.281=0.002
max0.879-1.033=-0.155
policies=20
mean1758.528-1758.507=0.022
σ0.354-0.349=0.005
min1758.295-1758.278=0.016
max1759.054-1759.023=0.031
mean820.000
σ0.000
min820.000
max820.000
mean2833.000-2829.000=4.000
σ0.000
min2833.000-2829.000=4.000
max2833.000-2829.000=4.000
mean2.782-2.800=-0.018
σ0.006-0.019=-0.013
min2.777-2.785=-0.007
max2.790-2.828=-0.038
policies=200
mean17592.141-17592.184=-0.043
σ0.543-0.526=0.018
min17591.855-17591.812=0.043
max17592.956-17592.956=0.000
mean8200.000
σ0.000
min8200.000
max8200.000
mean2833.000-2829.000=4.000
σ0.000
min2833.000-2829.000=4.000
max2833.000-2829.000=4.000
mean27.936-27.810=0.126
σ0.363-0.458=-0.095
min27.636-27.405=0.231
max28.399-28.262=0.137