Compare commits

Home / Compare 233f63b3 .. 112b13f0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.952-35.951=0.001
σ0.101-0.103=-0.002
min35.911-35.910=0.001
max36.239-36.242=-0.003
mean416.000-418.200=-2.200
σ0.000-0.422=-0.422
min416.000-418.000=-2.000
max416.000-419.000=-3.000
mean0.078-0.078=0.000
σ0.004-0.004=0.000
min0.074-0.074=-0.000
max0.085-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.199-26.199=0.000
σ0.004-0.003=0.001
min26.194-26.193=0.000
max26.207-26.202=0.005
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.060-0.061=-0.001
σ0.003-0.003=0.000
min0.057-0.059=-0.002
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.299-1756.300=-0.001
σ0.369-0.366=0.003
min1755.722-1755.722=-0.001
max1756.890-1756.894=-0.004
mean1659.750-1661.200=-1.450
σ631.421-626.711=4.710
min614.000-616.000=-2.000
max2730.000-2647.000=83.000
mean2.398-2.408=-0.010
σ0.117-0.183=-0.066
min2.273-2.295=-0.023
max2.752-3.141=-0.389

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.815-278.816=-0.000
σ0.005-0.005=-0.001
min278.807-278.811=-0.004
max278.819-278.825=-0.006
mean2730.000-2647.000=83.000
σ0.000
min2730.000-2647.000=83.000
max2730.000-2647.000=83.000
mean0.411-0.417=-0.005
σ0.005-0.006=-0.000
min0.407-0.408=-0.001
max0.418-0.423=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2268.881-2268.879=0.001
σ0.008-0.013=-0.006
min2268.876-2268.868=0.008
max2268.894-2268.899=-0.004
mean2730.000-2647.000=83.000
σ0.000
min2730.000-2647.000=83.000
max2730.000-2647.000=83.000
mean3.043-3.027=0.016
σ0.099-0.116=-0.017
min2.929-2.880=0.048
max3.154-3.130=0.024
iters=5
new-facts=6402
prior-facts=1
mean4954.217-4954.258=-0.041
σ0.867-0.890=-0.023
min4953.681-4953.755=-0.074
max4955.758-4955.844=-0.086
mean2730.000-2647.000=83.000
σ0.000
min2730.000-2647.000=83.000
max2730.000-2647.000=83.000
mean8.177-8.073=0.103
σ0.366-0.522=-0.156
min7.837-7.659=0.177
max8.673-8.981=-0.308
iters=5
new-facts=6402
prior-facts=6402
mean5168.719-5168.784=-0.065
σ0.204-0.086=0.118
min5168.377-5168.704=-0.327
max5168.876-5168.881=-0.006
mean3378.400-3439.800=-61.400
σ535.296-472.457=62.839
min2903.000-2905.000=-2.000
max4152.000-4155.000=-3.000
mean9.111-9.380=-0.269
σ0.326-0.277=0.049
min8.570-8.995=-0.425
max9.357-9.687=-0.330

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.172=-0.120
σ0.134-0.274=-0.140
min0.930-0.972=-0.042
max1.261-1.655=-0.394

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.801-459.806=-0.005
σ571.582-571.582=-0.000
min174.003-174.010=-0.007
max1317.174-1317.179=-0.006
mean79.500
σ7.000
min76.000
max90.000
mean2730.000-2647.000=83.000
σ0.000
min2730.000-2647.000=83.000
max2730.000-2647.000=83.000
mean0.535-0.562=-0.027
σ0.534-0.582=-0.048
min0.264-0.267=-0.003
max1.336-1.435=-0.099
policies=20
mean1740.330-1740.321=0.009
σ0.319-0.321=-0.002
min1740.127-1740.106=0.021
max1740.805-1740.798=0.007
mean760.000
σ0.000
min760.000
max760.000
mean2730.000-2647.000=83.000
σ0.000
min2730.000-2647.000=83.000
max2730.000-2647.000=83.000
mean2.700-2.693=0.007
σ0.012-0.014=-0.001
min2.686-2.676=0.010
max2.713-2.708=0.005
policies=200
mean17410.155-17410.081=0.073
σ0.399-0.459=-0.061
min17409.943-17409.802=0.141
max17410.753-17410.763=-0.011
mean7600.000
σ0.000
min7600.000
max7600.000
mean2730.000-2647.000=83.000
σ0.000
min2730.000-2647.000=83.000
max2730.000-2647.000=83.000
mean27.022-27.105=-0.084
σ0.061-0.058=0.003
min26.952-27.055=-0.103
max27.100-27.173=-0.073