Compare commits

Home / Compare 2c611dc2 .. 38ef9b87

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.244=0.001
σ0.054-0.057=-0.003
min35.213-35.213=-0.000
max35.398-35.405=-0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.083=0.002
σ0.005-0.005=-0.000
min0.077-0.076=0.001
max0.094-0.092=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.002-0.002=0.000
min23.765-23.767=-0.002
max23.771-23.772=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.067-0.065=0.002
σ0.002-0.003=-0.000
min0.066-0.061=0.004
max0.074-0.067=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.486=0.001
σ0.366-0.364=0.002
min1755.908-1755.911=-0.003
max1757.071-1757.072=-0.001
mean1654.200-1628.700=25.500
σ644.519-594.497=50.022
min626.000-651.000=-25.000
max2843.000-2429.000=414.000
mean2.326-2.332=-0.006
σ0.071-0.082=-0.011
min2.213-2.221=-0.008
max2.519-2.513=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.701-324.700=0.001
σ0.057-0.053=0.005
min324.601-324.607=-0.006
max324.736-324.732=0.005
mean2843.000-2429.000=414.000
σ0.000
min2843.000-2429.000=414.000
max2843.000-2429.000=414.000
mean0.432-0.428=0.004
σ0.011-0.008=0.002
min0.425-0.421=0.004
max0.450-0.442=0.008
iters=5
new-facts=1
prior-facts=6402
mean1985.269-1985.260=0.009
σ0.006-0.016=-0.010
min1985.263-1985.233=0.030
max1985.279-1985.276=0.003
mean2843.000-2429.000=414.000
σ0.000
min2843.000-2429.000=414.000
max2843.000-2429.000=414.000
mean2.610-2.655=-0.045
σ0.089-0.173=-0.083
min2.515-2.520=-0.005
max2.721-2.924=-0.203
iters=5
new-facts=6402
prior-facts=1
mean4808.761-4808.868=-0.106
σ7.797-7.717=0.080
min4804.826-4805.364=-0.538
max4822.700-4822.672=0.028
mean2843.000-2429.000=414.000
σ0.000
min2843.000-2429.000=414.000
max2843.000-2429.000=414.000
mean9.014-9.021=-0.007
σ0.185-0.204=-0.019
min8.897-8.807=0.091
max9.340-9.320=0.020
iters=5
new-facts=6402
prior-facts=6402
mean4996.460-4996.461=-0.001
σ0.025-0.010=0.015
min4996.433-4996.449=-0.017
max4996.487-4996.472=0.015
mean3061.200-2941.200=120.000
σ233.615-452.330=-218.714
min2843.000-2429.000=414.000
max3406.000-3547.000=-141.000
mean8.689-8.506=0.183
σ0.183-0.095=0.088
min8.504-8.426=0.078
max8.943-8.663=0.280

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.605=-0.578
σ0.046-0.253=-0.207
min0.946-1.214=-0.268
max1.054-1.822=-0.768

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.944=0.026
σ574.251-574.250=0.001
min175.840-175.815=0.025
max1324.346-1324.319=0.028
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2429.000=414.000
σ0.000
min2843.000-2429.000=414.000
max2843.000-2429.000=414.000
mean0.432-0.569=-0.137
σ0.300-0.592=-0.291
min0.278-0.271=0.007
max0.882-1.456=-0.574
policies=20
mean1758.705-1758.483=0.222
σ0.342-0.340=0.002
min1758.477-1758.241=0.236
max1759.213-1758.985=0.228
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2429.000=414.000
σ0.000
min2843.000-2429.000=414.000
max2843.000-2429.000=414.000
mean2.778-2.710=0.068
σ0.002-0.019=-0.017
min2.776-2.689=0.087
max2.780-2.727=0.054
policies=200
mean17593.396-17592.296=1.100
σ0.590-0.549=0.041
min17592.617-17591.908=0.710
max17593.871-17593.108=0.763
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2429.000=414.000
σ0.000
min2843.000-2429.000=414.000
max2843.000-2429.000=414.000
mean27.881-27.468=0.413
σ0.271-0.168=0.103
min27.605-27.305=0.300
max28.144-27.670=0.474