Compare commits

Home / Compare 9f1f30c0 .. bca67954

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.001
σ0.052-0.055=-0.002
min35.592-35.592=0.000
max35.765-35.772=-0.007
mean414.000-414.200=-0.200
σ0.000-0.422=-0.422
min414.000
max414.000-415.000=-1.000
mean0.085-0.086=-0.001
σ0.004-0.003=0.000
min0.081-0.083=-0.002
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-24.047=0.001
σ0.003-0.002=0.001
min24.040-24.043=-0.003
max24.051-24.050=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.068-0.065=0.003
σ0.003-0.004=-0.001
min0.066-0.061=0.004
max0.076-0.072=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.490=-0.001
σ0.365-0.365=-0.001
min1755.915-1755.914=0.001
max1757.075-1757.081=-0.006
mean1652.200-1649.550=2.650
σ644.668-640.658=4.010
min649.000-633.000=16.000
max2840.000-2828.000=12.000
mean2.352-2.358=-0.006
σ0.080-0.064=0.016
min2.267-2.287=-0.020
max2.533-2.493=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.768=-0.008
σ0.043-0.047=-0.004
min324.684-324.686=-0.001
max324.790-324.800=-0.010
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean0.417-0.431=-0.014
σ0.002-0.020=-0.018
min0.416-0.421=-0.005
max0.420-0.467=-0.047
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.313=0.000
σ0.015-0.021=-0.006
min1985.292-1985.286=0.006
max1985.334-1985.336=-0.002
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean2.636-2.660=-0.024
σ0.129-0.170=-0.041
min2.515-2.453=0.062
max2.817-2.885=-0.068
iters=5
new-facts=6402
prior-facts=1
mean4809.111-4809.091=0.019
σ7.773-7.718=0.056
min4805.604-4805.575=0.028
max4823.016-4822.897=0.119
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean9.162-8.917=0.246
σ0.341-0.181=0.160
min8.925-8.598=0.327
max9.755-9.032=0.724
iters=5
new-facts=6402
prior-facts=6402
mean4996.552-4996.621=-0.069
σ0.151-0.027=0.124
min4996.285-4996.595=-0.310
max4996.646-4996.654=-0.008
mean3047.600-3067.000=-19.400
σ270.853-310.052=-39.199
min2840.000-2828.000=12.000
max3465.000-3541.000=-76.000
mean8.503-8.560=-0.057
σ0.114-0.116=-0.003
min8.444-8.454=-0.010
max8.705-8.746=-0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.953=0.028
σ0.068-0.054=0.014
min0.924-0.922=0.001
max1.056-1.048=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.205=-0.000
σ574.774-574.766=0.008
min175.808-175.819=-0.011
max1325.366-1325.355=0.011
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean0.430-0.431=-0.001
σ0.299-0.300=-0.001
min0.278-0.279=-0.001
max0.878-0.880=-0.002
policies=20
mean1758.488-1758.534=-0.046
σ0.353-0.353=0.000
min1758.241-1758.301=-0.061
max1759.009-1759.058=-0.048
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean2.788-2.784=0.004
σ0.005-0.054=-0.049
min2.781-2.725=0.056
max2.792-2.849=-0.057
policies=200
mean17591.980-17592.080=-0.100
σ0.432-0.579=-0.147
min17591.725-17591.529=0.196
max17592.626-17592.897=-0.271
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean27.908-27.910=-0.002
σ0.376-0.661=-0.285
min27.527-27.283=0.244
max28.323-28.742=-0.419