Compare commits

Home / Compare ceca361e .. 418642c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.049-0.049=-0.000
min33.951-33.945=0.006
max34.114-34.115=-0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.085-0.082=0.003
σ0.003-0.004=-0.001
min0.082-0.075=0.007
max0.090-0.087=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.004=-0.001
min23.312-23.311=0.001
max23.323-23.322=0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.065-0.064=0.001
σ0.004-0.004=0.000
min0.059-0.059=0.000
max0.073-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.304-1757.303=0.001
σ0.365-0.364=0.001
min1756.728-1756.729=-0.001
max1757.891-1757.890=0.001
mean1662.600-1665.850=-3.250
σ620.488-626.958=-6.470
min673.000-672.000=1.000
max2591.000-2612.000=-21.000
mean2.359-2.345=0.015
σ0.103-0.137=-0.034
min2.268-2.127=0.141
max2.714-2.746=-0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.448-326.439=0.009
σ0.042-0.058=-0.016
min326.375-326.335=0.040
max326.488-326.480=0.008
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean0.430-0.424=0.006
σ0.006-0.006=0.000
min0.427-0.420=0.007
max0.442-0.435=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.618-1988.597=0.022
σ0.004-0.003=0.001
min1988.613-1988.594=0.019
max1988.622-1988.601=0.021
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean2.735-2.735=-0.000
σ0.206-0.121=0.085
min2.570-2.635=-0.065
max3.093-2.931=0.162
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.332=0.125
σ7.752-7.778=-0.026
min4809.912-4809.455=0.458
max4827.325-4827.240=0.084
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean8.610-8.977=-0.367
σ0.550-0.359=0.191
min7.847-8.364=-0.517
max9.395-9.242=0.153
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5001.010=-0.000
σ0.019-0.022=-0.003
min5000.990-5000.986=0.004
max5001.037-5001.029=0.008
mean2947.400-3015.800=-68.400
σ360.576-305.686=54.891
min2591.000-2612.000=-21.000
max3423.000-3410.000=13.000
mean9.647-9.781=-0.134
σ0.179-0.156=0.023
min9.362-9.599=-0.236
max9.811-9.992=-0.180

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.257-1.255=0.003
σ0.399-0.395=0.004
min0.917-0.924=-0.007
max1.745-1.769=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.437-464.440=-0.003
σ574.792-574.793=-0.000
min177.037-177.039=-0.002
max1326.626-1326.629=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean0.549-0.544=0.005
σ0.548-0.535=0.013
min0.272-0.272=-0.000
max1.370-1.346=0.024
policies=20
mean1770.764-1770.765=-0.001
σ0.368-0.378=-0.010
min1770.524-1770.513=0.010
max1771.310-1771.326=-0.016
mean840.000
σ0.000
min840.000
max840.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean2.741-2.762=-0.021
σ0.008-0.019=-0.011
min2.733-2.744=-0.012
max2.750-2.787=-0.037
policies=200
mean17714.923-17714.919=0.004
σ0.510-0.473=0.037
min17714.608-17714.627=-0.019
max17715.683-17715.624=0.059
mean8400.000
σ0.000
min8400.000
max8400.000
mean2591.000-2612.000=-21.000
σ0.000
min2591.000-2612.000=-21.000
max2591.000-2612.000=-21.000
mean27.555-27.404=0.150
σ0.100-0.098=0.002
min27.455-27.287=0.168
max27.679-27.509=0.171