Compare commits

Home / Compare e7443c54 .. 40e2c2ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.570=0.125
σ0.045-0.042=0.003
min70.670-70.545=0.126
max70.819-70.689=0.131
mean412.000-415.800=-3.800
σ0.000-0.422=-0.422
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.160-0.161=-0.001
σ0.003-0.004=-0.001
min0.158-0.157=0.001
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.424-21.291=0.133
σ0.003-0.002=0.001
min21.419-21.288=0.132
max21.429-21.295=0.133
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.062-0.065=-0.002
σ0.004-0.002=0.001
min0.059-0.063=-0.004
max0.068-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.056-1749.769=1.287
σ0.361-0.359=0.002
min1750.481-1749.201=1.280
max1751.634-1750.351=1.283
mean1640.850-1657.000=-16.150
σ597.032-642.118=-45.086
min624.000-623.000=1.000
max2442.000-2888.000=-446.000
mean2.862-2.819=0.043
σ0.094-0.178=-0.084
min2.720-2.174=0.546
max3.060-2.985=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.085-268.233=1.852
σ0.004-0.005=-0.001
min270.079-268.230=1.849
max270.090-268.242=1.847
mean2442.000-2888.000=-446.000
σ0.000
min2442.000-2888.000=-446.000
max2442.000-2888.000=-446.000
mean0.381-0.383=-0.002
σ0.006-0.009=-0.003
min0.376-0.373=0.002
max0.391-0.395=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.486-1928.645=1.841
σ0.006-0.014=-0.008
min1930.478-1928.629=1.849
max1930.492-1928.664=1.828
mean2442.000-2888.000=-446.000
σ0.000
min2442.000-2888.000=-446.000
max2442.000-2888.000=-446.000
mean2.948-2.948=-0.001
σ0.127-0.165=-0.038
min2.766-2.675=0.091
max3.109-3.118=-0.010
iters=5
new-facts=6402
prior-facts=1
mean4751.250-4749.251=1.998
σ0.836-1.005=-0.170
min4750.765-4748.395=2.370
max4752.733-4750.991=1.741
mean2442.000-2888.000=-446.000
σ0.000
min2442.000-2888.000=-446.000
max2442.000-2888.000=-446.000
mean8.586-8.661=-0.075
σ0.387-0.264=0.123
min8.012-8.373=-0.361
max9.013-9.051=-0.038
iters=5
new-facts=6402
prior-facts=6402
mean4941.716-4939.837=1.879
σ0.019-0.014=0.005
min4941.694-4939.815=1.879
max4941.734-4939.851=1.883
mean2989.400-3081.600=-92.200
σ263.842-212.043=51.799
min2629.000-2888.000=-259.000
max3297.000-3402.000=-105.000
mean8.639-8.525=0.115
σ0.239-0.143=0.097
min8.475-8.360=0.115
max9.060-8.725=0.335

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.813-1.047=0.765
σ0.129-0.178=-0.049
min1.596-0.936=0.660
max1.924-1.348=0.576

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.780-465.515=0.265
σ574.930-575.927=-0.997
min178.312-177.538=0.774
max1328.176-1329.406=-1.230
mean86.250
σ8.500
min82.000
max99.000
mean2442.000-2888.000=-446.000
σ0.000
min2442.000-2888.000=-446.000
max2442.000-2888.000=-446.000
mean0.555-0.480=0.075
σ0.553-0.374=0.178
min0.276-0.289=-0.013
max1.385-1.042=0.343
policies=20
mean1783.420-1775.734=7.686
σ0.371-0.374=-0.002
min1783.187-1775.466=7.721
max1783.974-1776.283=7.690
mean820.000
σ0.000
min820.000
max820.000
mean2442.000-2888.000=-446.000
σ0.000
min2442.000-2888.000=-446.000
max2442.000-2888.000=-446.000
mean2.753-2.854=-0.101
σ0.011-0.005=0.005
min2.741-2.851=-0.110
max2.766-2.862=-0.096
policies=200
mean17841.260-17764.015=77.245
σ0.526-0.433=0.094
min17840.961-17763.764=77.197
max17842.045-17764.663=77.383
mean8200.000
σ0.000
min8200.000
max8200.000
mean2442.000-2888.000=-446.000
σ0.000
min2442.000-2888.000=-446.000
max2442.000-2888.000=-446.000
mean27.877-28.418=-0.541
σ0.064-0.430=-0.366
min27.823-27.898=-0.074
max27.970-28.808=-0.838