Compare commits

Home / Compare bd4ab6b7 .. 347cfc33

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.050-0.051=-0.001
min33.938-33.945=-0.008
max34.119-34.121=-0.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.082-0.084=-0.002
σ0.005-0.003=0.002
min0.076-0.081=-0.005
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.319-23.318=0.001
σ0.003-0.003=0.000
min23.313-23.315=-0.001
max23.324-23.324=-0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.065=-0.001
σ0.005-0.002=0.003
min0.059-0.064=-0.005
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=0.001
σ0.365-0.365=0.000
min1756.732-1756.728=0.004
max1757.893-1757.888=0.005
mean1657.550-1646.400=11.150
σ644.006-623.325=20.681
min626.000-638.000=-12.000
max2824.000-2825.000=-1.000
mean2.353-2.381=-0.028
σ0.072-0.079=-0.007
min2.274-2.246=0.028
max2.565-2.574=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.448-326.453=-0.006
σ0.035-0.041=-0.006
min326.388-326.381=0.007
max326.479-326.477=0.001
mean2824.000-2825.000=-1.000
σ0.000
min2824.000-2825.000=-1.000
max2824.000-2825.000=-1.000
mean0.427-0.424=0.002
σ0.006-0.002=0.004
min0.421-0.421=-0.000
max0.434-0.426=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.605-1988.603=0.002
σ0.016-0.010=0.006
min1988.586-1988.590=-0.004
max1988.620-1988.616=0.003
mean2824.000-2825.000=-1.000
σ0.000
min2824.000-2825.000=-1.000
max2824.000-2825.000=-1.000
mean2.682-2.724=-0.042
σ0.067-0.172=-0.105
min2.636-2.540=0.095
max2.800-2.943=-0.144
iters=5
new-facts=6402
prior-facts=1
mean4813.266-4813.362=-0.096
σ7.900-7.790=0.110
min4808.830-4809.353=-0.523
max4827.366-4827.286=0.080
mean2824.000-2825.000=-1.000
σ0.000
min2824.000-2825.000=-1.000
max2824.000-2825.000=-1.000
mean8.781-8.439=0.341
σ0.619-0.521=0.098
min7.802-7.938=-0.136
max9.436-9.240=0.196
iters=5
new-facts=6402
prior-facts=6402
mean5001.012-5000.794=0.217
σ0.027-0.184=-0.157
min5000.982-5000.645=0.337
max5001.041-5001.015=0.026
mean3031.200-3056.400=-25.200
σ213.774-310.902=-97.128
min2824.000-2825.000=-1.000
max3332.000-3538.000=-206.000
mean9.808-9.703=0.105
σ0.149-0.233=-0.084
min9.704-9.324=0.380
max10.068-9.965=0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.089=-0.048
σ0.132-0.241=-0.109
min0.921-0.916=0.005
max1.248-1.505=-0.257

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.443-464.441=0.002
σ574.775-574.772=0.003
min177.047-177.043=0.004
max1326.605-1326.599=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2824.000-2825.000=-1.000
σ0.000
min2824.000-2825.000=-1.000
max2824.000-2825.000=-1.000
mean0.434-0.438=-0.004
σ0.307-0.306=0.001
min0.279-0.279=0.000
max0.895-0.898=-0.002
policies=20
mean1770.777-1770.792=-0.015
σ0.360-0.369=-0.009
min1770.540-1770.536=0.004
max1771.312-1771.339=-0.027
mean840.000
σ0.000
min840.000
max840.000
mean2824.000-2825.000=-1.000
σ0.000
min2824.000-2825.000=-1.000
max2824.000-2825.000=-1.000
mean2.780-2.780=-0.000
σ0.002-0.022=-0.019
min2.778-2.750=0.028
max2.783-2.801=-0.018
policies=200
mean17715.005-17714.808=0.196
σ0.450-0.466=-0.016
min17714.671-17714.392=0.279
max17715.668-17715.458=0.210
mean8400.000
σ0.000
min8400.000
max8400.000
mean2824.000-2825.000=-1.000
σ0.000
min2824.000-2825.000=-1.000
max2824.000-2825.000=-1.000
mean27.810-27.940=-0.130
σ0.375-0.379=-0.004
min27.439-27.522=-0.083
max28.219-28.351=-0.132