Compare commits

Home / Compare c75a92b1 .. 1dfc508b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.049-0.048=0.001
min33.946-33.947=-0.000
max34.113-34.110=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.085-0.082=0.003
σ0.004-0.005=-0.002
min0.082-0.076=0.006
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.003-0.001=0.001
min23.313-23.315=-0.002
max23.320-23.319=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.064=-0.002
σ0.003-0.004=-0.001
min0.060-0.059=0.001
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=0.000
σ0.366-0.364=0.002
min1756.728-1756.729=-0.001
max1757.896-1757.891=0.005
mean1651.950-1660.950=-9.000
σ627.598-621.691=5.907
min675.000-669.000=6.000
max2600.000-2591.000=9.000
mean2.335-2.371=-0.035
σ0.127-0.139=-0.011
min2.202-2.212=-0.010
max2.644-2.695=-0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-326.438=0.015
σ0.032-0.059=-0.027
min326.399-326.333=0.066
max326.475-326.470=0.005
mean2600.000-2591.000=9.000
σ0.000
min2600.000-2591.000=9.000
max2600.000-2591.000=9.000
mean0.423-0.426=-0.003
σ0.002-0.002=0.000
min0.420-0.425=-0.005
max0.425-0.429=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.602-1988.607=-0.005
σ0.032-0.016=0.015
min1988.549-1988.582=-0.033
max1988.626-1988.621=0.005
mean2600.000-2591.000=9.000
σ0.000
min2600.000-2591.000=9.000
max2600.000-2591.000=9.000
mean2.700-2.677=0.024
σ0.178-0.071=0.107
min2.581-2.578=0.003
max3.015-2.774=0.241
iters=5
new-facts=6402
prior-facts=1
mean4813.508-4813.474=0.034
σ7.706-7.754=-0.048
min4809.898-4809.903=-0.005
max4827.291-4827.343=-0.053
mean2600.000-2591.000=9.000
σ0.000
min2600.000-2591.000=9.000
max2600.000-2591.000=9.000
mean8.407-8.617=-0.211
σ0.609-0.606=0.003
min7.710-7.965=-0.255
max9.314-9.569=-0.256
iters=5
new-facts=6402
prior-facts=6402
mean5001.022-5001.008=0.013
σ0.031-0.019=0.012
min5000.987-5000.985=0.002
max5001.056-5001.025=0.031
mean2961.200-2978.600=-17.400
σ266.229-288.348=-22.120
min2626.000-2591.000=35.000
max3323.000-3319.000=4.000
mean9.927-9.808=0.119
σ0.188-0.088=0.100
min9.706-9.713=-0.008
max10.219-9.928=0.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.240=-0.079
σ0.334-0.377=-0.043
min0.917-0.915=0.002
max1.731-1.713=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.437-464.436=0.001
σ574.785-574.790=-0.005
min177.039-177.035=0.004
max1326.614-1326.621=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2600.000-2591.000=9.000
σ0.000
min2600.000-2591.000=9.000
max2600.000-2591.000=9.000
mean0.550-0.556=-0.006
σ0.553-0.561=-0.008
min0.271-0.272=-0.001
max1.380-1.398=-0.018
policies=20
mean1770.769-1770.742=0.027
σ0.358-0.345=0.013
min1770.533-1770.519=0.013
max1771.301-1771.255=0.045
mean840.000
σ0.000
min840.000
max840.000
mean2600.000-2591.000=9.000
σ0.000
min2600.000-2591.000=9.000
max2600.000-2591.000=9.000
mean2.724-2.725=-0.001
σ0.025-0.011=0.014
min2.694-2.714=-0.019
max2.753-2.737=0.016
policies=200
mean17714.788-17714.794=-0.006
σ0.609-0.622=-0.013
min17714.352-17714.356=-0.003
max17715.686-17715.712=-0.027
mean8400.000
σ0.000
min8400.000
max8400.000
mean2600.000-2591.000=9.000
σ0.000
min2600.000-2591.000=9.000
max2600.000-2591.000=9.000
mean27.398-27.583=-0.184
σ0.127-0.188=-0.061
min27.224-27.410=-0.186
max27.507-27.782=-0.275