Compare commits

Home / Compare 4087abbe .. 760625a9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.048-0.048=-0.000
min33.950-33.947=0.003
max34.110-34.110=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.085-0.082=0.003
σ0.003-0.005=-0.002
min0.082-0.076=0.006
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.001=0.001
min23.312-23.315=-0.003
max23.320-23.319=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.070-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.427-1757.303=0.125
σ0.364-0.364=-0.000
min1756.853-1756.729=0.124
max1758.013-1757.891=0.122
mean1665.700-1660.950=4.750
σ628.678-621.691=6.987
min670.000-669.000=1.000
max2616.000-2591.000=25.000
mean2.376-2.371=0.005
σ0.106-0.139=-0.033
min2.279-2.212=0.067
max2.716-2.695=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.565-326.438=0.127
σ0.055-0.059=-0.004
min326.467-326.333=0.134
max326.597-326.470=0.127
mean2616.000-2591.000=25.000
σ0.000
min2616.000-2591.000=25.000
max2616.000-2591.000=25.000
mean0.424-0.426=-0.001
σ0.001-0.002=-0.000
min0.422-0.425=-0.003
max0.426-0.429=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.737-1988.607=0.130
σ0.007-0.016=-0.009
min1988.726-1988.582=0.144
max1988.745-1988.621=0.124
mean2616.000-2591.000=25.000
σ0.000
min2616.000-2591.000=25.000
max2616.000-2591.000=25.000
mean2.705-2.677=0.028
σ0.041-0.071=-0.030
min2.670-2.578=0.092
max2.774-2.774=0.000
iters=5
new-facts=6402
prior-facts=1
mean4813.619-4813.474=0.145
σ7.696-7.754=-0.058
min4810.043-4809.903=0.140
max4827.385-4827.343=0.042
mean2616.000-2591.000=25.000
σ0.000
min2616.000-2591.000=25.000
max2616.000-2591.000=25.000
mean8.251-8.617=-0.367
σ0.516-0.606=-0.089
min7.725-7.965=-0.240
max9.070-9.569=-0.499
iters=5
new-facts=6402
prior-facts=6402
mean5001.134-5001.008=0.126
σ0.038-0.019=0.019
min5001.067-5000.985=0.081
max5001.162-5001.025=0.137
mean2943.000-2978.600=-35.600
σ359.059-288.348=70.711
min2616.000-2591.000=25.000
max3437.000-3319.000=118.000
mean9.779-9.808=-0.030
σ0.252-0.088=0.164
min9.420-9.713=-0.294
max10.134-9.928=0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.196-1.240=-0.044
σ0.381-0.377=0.004
min0.906-0.915=-0.009
max1.677-1.713=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.564-464.436=0.129
σ574.780-574.790=-0.010
min177.170-177.035=0.135
max1326.734-1326.621=0.113
mean88.250
σ8.500
min84.000
max101.000
mean2616.000-2591.000=25.000
σ0.000
min2616.000-2591.000=25.000
max2616.000-2591.000=25.000
mean0.538-0.556=-0.017
σ0.524-0.561=-0.037
min0.276-0.272=0.004
max1.325-1.398=-0.073
policies=20
mean1772.002-1770.742=1.260
σ0.353-0.345=0.008
min1771.769-1770.519=1.250
max1772.526-1771.255=1.271
mean840.000
σ0.000
min840.000
max840.000
mean2616.000-2591.000=25.000
σ0.000
min2616.000-2591.000=25.000
max2616.000-2591.000=25.000
mean2.743-2.725=0.018
σ0.044-0.011=0.032
min2.711-2.714=-0.003
max2.806-2.737=0.070
policies=200
mean17727.325-17714.794=12.531
σ0.416-0.622=-0.206
min17727.014-17714.356=12.658
max17727.927-17715.712=12.215
mean8400.000
σ0.000
min8400.000
max8400.000
mean2616.000-2591.000=25.000
σ0.000
min2616.000-2591.000=25.000
max2616.000-2591.000=25.000
mean27.467-27.583=-0.116
σ0.109-0.188=-0.079
min27.356-27.410=-0.054
max27.561-27.782=-0.221