Compare commits

Home / Compare 5ab570a8 .. d02ee98e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.782=-0.002
σ0.054-0.055=-0.001
min70.749-70.745=0.004
max70.929-70.935=-0.005
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.161-0.161=-0.000
σ0.003-0.004=-0.001
min0.158-0.155=0.003
max0.166-0.170=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=-0.000
σ0.003-0.004=-0.001
min21.491-21.491=0.000
max21.498-21.502=-0.004
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.065-0.065=-0.000
σ0.004-0.002=0.002
min0.060-0.064=-0.004
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.122-1751.121=0.001
σ0.360-0.359=0.001
min1750.547-1750.546=0.001
max1751.705-1751.705=-0.000
mean1641.550-1638.550=3.000
σ629.502-626.253=3.249
min625.000-626.000=-1.000
max2800.000-2793.000=7.000
mean2.857-2.810=0.046
σ0.102-0.175=-0.073
min2.716-2.155=0.562
max3.098-2.986=0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean268.622-268.620=0.002
σ0.006-0.005=0.002
min268.616-268.613=0.002
max268.629-268.624=0.005
mean2800.000-2793.000=7.000
σ0.000
min2800.000-2793.000=7.000
max2800.000-2793.000=7.000
mean0.377-0.376=0.002
σ0.006-0.005=0.001
min0.369-0.371=-0.002
max0.385-0.382=0.004
iters=5
new-facts=1
prior-facts=6402
mean1929.012-1929.006=0.006
σ0.018-0.020=-0.001
min1928.989-1928.987=0.002
max1929.029-1929.032=-0.003
mean2800.000-2793.000=7.000
σ0.000
min2800.000-2793.000=7.000
max2800.000-2793.000=7.000
mean2.521-2.557=-0.036
σ0.165-0.155=0.011
min2.293-2.384=-0.091
max2.744-2.748=-0.004
iters=5
new-facts=6402
prior-facts=1
mean4749.649-4749.735=-0.086
σ0.969-0.862=0.107
min4748.662-4749.224=-0.563
max4751.272-4751.270=0.002
mean2800.000-2793.000=7.000
σ0.000
min2800.000-2793.000=7.000
max2800.000-2793.000=7.000
mean8.429-8.732=-0.303
σ0.556-0.352=0.204
min7.820-8.342=-0.522
max9.154-9.164=-0.010
iters=5
new-facts=6402
prior-facts=6402
mean4940.159-4940.223=-0.063
σ0.153-0.016=0.137
min4939.887-4940.205=-0.318
max4940.253-4940.240=0.013
mean2997.800-2994.800=3.000
σ262.515-263.962=-1.447
min2800.000-2793.000=7.000
max3416.000-3413.000=3.000
mean8.587-8.414=0.173
σ0.452-0.043=0.409
min8.305-8.365=-0.059
max9.386-8.460=0.926

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-0.997=0.084
σ0.116-0.140=-0.024
min0.931-0.927=0.004
max1.257-1.247=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.716-462.712=0.003
σ574.962-574.956=0.007
min175.226-175.226=-0.000
max1325.159-1325.146=0.013
mean86.250
σ8.500
min82.000
max99.000
mean2800.000-2793.000=7.000
σ0.000
min2800.000-2793.000=7.000
max2800.000-2793.000=7.000
mean0.479-0.478=0.002
σ0.406-0.404=0.002
min0.275-0.274=0.001
max1.089-1.084=0.005
policies=20
mean1752.499-1752.482=0.017
σ0.367-0.350=0.016
min1752.267-1752.279=-0.012
max1753.046-1753.007=0.039
mean820.000
σ0.000
min820.000
max820.000
mean2800.000-2793.000=7.000
σ0.000
min2800.000-2793.000=7.000
max2800.000-2793.000=7.000
mean2.738-2.718=0.020
σ0.012-0.011=0.001
min2.721-2.706=0.015
max2.750-2.733=0.017
policies=200
mean17532.331-17532.194=0.137
σ0.501-0.577=-0.076
min17532.041-17531.810=0.230
max17533.080-17533.053=0.027
mean8200.000
σ0.000
min8200.000
max8200.000
mean2800.000-2793.000=7.000
σ0.000
min2800.000-2793.000=7.000
max2800.000-2793.000=7.000
mean27.532-27.475=0.057
σ0.157-0.113=0.044
min27.415-27.344=0.071
max27.759-27.584=0.174