Compare commits

Home / Compare 79906aca .. 1872fcb4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.050-0.049=0.001
min33.951-33.952=-0.001
max34.118-34.114=0.004
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.084-0.085=-0.000
σ0.003-0.003=-0.000
min0.081-0.082=-0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.002=0.001
min23.314-23.314=-0.000
max23.324-23.321=0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.066-0.065=0.000
σ0.002-0.002=0.000
min0.063-0.064=-0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.429=0.064
σ0.363-0.364=-0.001
min1756.922-1756.855=0.067
max1758.081-1758.016=0.065
mean1671.750-1655.850=15.900
σ643.795-642.846=0.949
min677.000-623.000=54.000
max2650.000-2737.000=-87.000
mean2.378-2.374=0.004
σ0.116-0.085=0.031
min2.256-2.277=-0.021
max2.728-2.567=0.161

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.581=0.057
σ0.050-0.027=0.023
min326.549-326.535=0.014
max326.673-326.606=0.068
mean2650.000-2737.000=-87.000
σ0.000
min2650.000-2737.000=-87.000
max2650.000-2737.000=-87.000
mean0.428-0.421=0.006
σ0.006-0.001=0.005
min0.423-0.421=0.002
max0.435-0.423=0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.807-1988.740=0.068
σ0.007-0.014=-0.007
min1988.796-1988.723=0.073
max1988.813-1988.754=0.059
mean2650.000-2737.000=-87.000
σ0.000
min2650.000-2737.000=-87.000
max2650.000-2737.000=-87.000
mean2.702-2.672=0.029
σ0.086-0.054=0.032
min2.598-2.614=-0.016
max2.799-2.762=0.037
iters=5
new-facts=6402
prior-facts=1
mean4813.427-4813.457=-0.030
σ7.872-7.767=0.105
min4809.065-4809.546=-0.481
max4827.480-4827.344=0.137
mean2650.000-2737.000=-87.000
σ0.000
min2650.000-2737.000=-87.000
max2650.000-2737.000=-87.000
mean8.737-8.787=-0.050
σ0.483-0.293=0.190
min8.076-8.323=-0.247
max9.161-9.072=0.090
iters=5
new-facts=6402
prior-facts=6402
mean5001.207-5001.157=0.050
σ0.046-0.035=0.011
min5001.158-5001.113=0.045
max5001.271-5001.200=0.071
mean3011.200-3014.800=-3.600
σ266.130-230.554=35.576
min2650.000-2737.000=-87.000
max3353.000-3288.000=65.000
mean9.500-9.993=-0.493
σ0.623-0.189=0.434
min8.487-9.674=-1.187
max10.165-10.173=-0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-0.964=0.223
σ0.360-0.067=0.294
min0.920-0.905=0.014
max1.789-1.046=0.742

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.634-464.565=0.070
σ574.778-574.771=0.007
min177.238-177.173=0.065
max1326.802-1326.721=0.081
mean88.250
σ8.500
min84.000
max101.000
mean2650.000-2737.000=-87.000
σ0.000
min2650.000-2737.000=-87.000
max2650.000-2737.000=-87.000
mean0.552-0.551=0.001
σ0.558-0.556=0.002
min0.270-0.271=-0.001
max1.389-1.384=0.005
policies=20
mean1772.685-1772.053=0.632
σ0.357-0.363=-0.006
min1772.444-1771.821=0.623
max1773.215-1772.594=0.621
mean840.000
σ0.000
min840.000
max840.000
mean2650.000-2737.000=-87.000
σ0.000
min2650.000-2737.000=-87.000
max2650.000-2737.000=-87.000
mean2.729-2.750=-0.021
σ0.019-0.043=-0.024
min2.707-2.703=0.004
max2.752-2.796=-0.043
policies=200
mean17733.908-17727.453=6.456
σ0.565-0.610=-0.045
min17733.620-17727.073=6.548
max17734.755-17728.363=6.392
mean8400.000
σ0.000
min8400.000
max8400.000
mean2650.000-2737.000=-87.000
σ0.000
min2650.000-2737.000=-87.000
max2650.000-2737.000=-87.000
mean27.585-27.494=0.091
σ0.081-0.125=-0.044
min27.513-27.347=0.166
max27.658-27.631=0.028