Compare commits

Home / Compare 6ba1f8de .. ce25a4fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.053-0.054=-0.001
min35.237-35.238=-0.001
max35.414-35.415=-0.001
mean413.600-414.000=-0.400
σ0.516-0.000=0.516
min413.000-414.000=-1.000
max414.000
mean0.085-0.085=-0.000
σ0.003-0.003=-0.000
min0.082-0.083=-0.000
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=-0.000
min23.767-23.766=0.001
max23.775-23.775=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.069-0.069=-0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.075-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.485=-0.000
σ0.365-0.366=-0.001
min1755.910-1755.912=-0.002
max1757.068-1757.076=-0.008
mean1651.000-1643.100=7.900
σ643.351-626.347=17.004
min626.000-628.000=-2.000
max2836.000-2827.000=9.000
mean2.347-2.370=-0.023
σ0.079-0.085=-0.006
min2.245-2.233=0.012
max2.535-2.583=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.707-324.710=-0.003
σ0.060-0.045=0.015
min324.601-324.631=-0.029
max324.743-324.738=0.005
mean2836.000-2827.000=9.000
σ0.000
min2836.000-2827.000=9.000
max2836.000-2827.000=9.000
mean0.431-0.421=0.011
σ0.011-0.001=0.010
min0.417-0.420=-0.002
max0.441-0.423=0.018
iters=5
new-facts=1
prior-facts=6402
mean1985.267-1985.252=0.015
σ0.012-0.016=-0.004
min1985.251-1985.231=0.021
max1985.278-1985.268=0.009
mean2836.000-2827.000=9.000
σ0.000
min2836.000-2827.000=9.000
max2836.000-2827.000=9.000
mean2.618-2.651=-0.033
σ0.060-0.097=-0.036
min2.557-2.566=-0.009
max2.693-2.775=-0.082
iters=5
new-facts=6402
prior-facts=1
mean4808.796-4808.896=-0.100
σ7.725-7.647=0.079
min4805.038-4805.418=-0.380
max4822.612-4822.573=0.038
mean2836.000-2827.000=9.000
σ0.000
min2836.000-2827.000=9.000
max2836.000-2827.000=9.000
mean8.272-8.781=-0.509
σ0.506-0.425=0.082
min7.757-8.087=-0.329
max8.945-9.243=-0.298
iters=5
new-facts=6402
prior-facts=6402
mean4996.461-4996.467=-0.006
σ0.023-0.015=0.007
min4996.433-4996.445=-0.012
max4996.487-4996.482=0.005
mean3062.000-3057.000=5.000
σ302.185-306.666=-4.481
min2836.000-2827.000=9.000
max3532.000-3531.000=1.000
mean8.651-8.509=0.142
σ0.391-0.121=0.270
min8.368-8.391=-0.023
max9.297-8.708=0.589

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.032=-0.059
σ0.063-0.131=-0.068
min0.919-0.916=0.003
max1.045-1.237=-0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-462.969=0.009
σ574.254-574.254=-0.000
min175.835-175.840=-0.005
max1324.358-1324.350=0.008
mean86.250
σ8.500
min82.000
max99.000
mean2836.000-2827.000=9.000
σ0.000
min2836.000-2827.000=9.000
max2836.000-2827.000=9.000
mean0.469-0.434=0.034
σ0.379-0.299=0.080
min0.276-0.284=-0.008
max1.037-0.883=0.154
policies=20
mean1758.717-1758.711=0.006
σ0.342-0.343=-0.001
min1758.484-1758.476=0.008
max1759.224-1759.219=0.005
mean820.000
σ0.000
min820.000
max820.000
mean2836.000-2827.000=9.000
σ0.000
min2836.000-2827.000=9.000
max2836.000-2827.000=9.000
mean2.779-2.765=0.013
σ0.009-0.005=0.005
min2.769-2.761=0.008
max2.791-2.771=0.019
policies=200
mean17593.254-17593.171=0.082
σ0.575-0.716=-0.141
min17592.421-17592.189=0.232
max17593.645-17593.833=-0.188
mean8200.000
σ0.000
min8200.000
max8200.000
mean2836.000-2827.000=9.000
σ0.000
min2836.000-2827.000=9.000
max2836.000-2827.000=9.000
mean27.869-27.770=0.099
σ0.369-0.335=0.035
min27.399-27.448=-0.049
max28.275-28.147=0.129