Compare commits

Home / Compare cada230f .. 51226b31

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.049-0.048=0.002
min33.947-33.947=0.000
max34.117-34.110=0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.085-0.082=0.003
σ0.003-0.005=-0.002
min0.082-0.076=0.006
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.000
σ0.004-0.001=0.003
min23.311-23.315=-0.004
max23.326-23.319=0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.063-0.059=0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.303=-0.001
σ0.366-0.364=0.002
min1756.727-1756.729=-0.002
max1757.894-1757.891=0.003
mean1652.850-1660.950=-8.100
σ623.883-621.691=2.192
min680.000-669.000=11.000
max2592.000-2591.000=1.000
mean2.365-2.371=-0.005
σ0.134-0.139=-0.005
min2.240-2.212=0.028
max2.669-2.695=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.448-326.438=0.010
σ0.043-0.059=-0.016
min326.374-326.333=0.041
max326.480-326.470=0.010
mean2592.000-2591.000=1.000
σ0.000
min2592.000-2591.000=1.000
max2592.000-2591.000=1.000
mean0.421-0.426=-0.005
σ0.001-0.002=-0.000
min0.420-0.425=-0.004
max0.423-0.429=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.611-1988.607=0.004
σ0.010-0.016=-0.006
min1988.594-1988.582=0.012
max1988.621-1988.621=-0.000
mean2592.000-2591.000=1.000
σ0.000
min2592.000-2591.000=1.000
max2592.000-2591.000=1.000
mean2.684-2.677=0.007
σ0.085-0.071=0.014
min2.596-2.578=0.018
max2.815-2.774=0.040
iters=5
new-facts=6402
prior-facts=1
mean4813.448-4813.474=-0.026
σ7.716-7.754=-0.038
min4809.989-4809.903=0.086
max4827.251-4827.343=-0.093
mean2592.000-2591.000=1.000
σ0.000
min2592.000-2591.000=1.000
max2592.000-2591.000=1.000
mean8.987-8.617=0.370
σ0.169-0.606=-0.436
min8.746-7.965=0.782
max9.152-9.569=-0.417
iters=5
new-facts=6402
prior-facts=6402
mean5001.019-5001.008=0.011
σ0.037-0.019=0.018
min5000.984-5000.985=-0.001
max5001.078-5001.025=0.052
mean3016.800-2978.600=38.200
σ261.460-288.348=-26.889
min2626.000-2591.000=35.000
max3323.000-3319.000=4.000
mean9.783-9.808=-0.026
σ0.387-0.088=0.299
min9.254-9.713=-0.459
max10.342-9.928=0.415

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.279-1.240=0.039
σ0.320-0.377=-0.057
min0.917-0.915=0.002
max1.653-1.713=-0.060

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.437-464.436=0.002
σ574.785-574.790=-0.005
min177.039-177.035=0.003
max1326.615-1326.621=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2592.000-2591.000=1.000
σ0.000
min2592.000-2591.000=1.000
max2592.000-2591.000=1.000
mean0.552-0.556=-0.004
σ0.558-0.561=-0.003
min0.272-0.272=0.000
max1.389-1.398=-0.008
policies=20
mean1770.761-1770.742=0.019
σ0.362-0.345=0.017
min1770.509-1770.519=-0.011
max1771.297-1771.255=0.041
mean840.000
σ0.000
min840.000
max840.000
mean2592.000-2591.000=1.000
σ0.000
min2592.000-2591.000=1.000
max2592.000-2591.000=1.000
mean2.725-2.725=-0.000
σ0.017-0.011=0.006
min2.706-2.714=-0.008
max2.747-2.737=0.011
policies=200
mean17714.820-17714.794=0.026
σ0.532-0.622=-0.090
min17714.350-17714.356=-0.006
max17715.581-17715.712=-0.131
mean8400.000
σ0.000
min8400.000
max8400.000
mean2592.000-2591.000=1.000
σ0.000
min2592.000-2591.000=1.000
max2592.000-2591.000=1.000
mean27.408-27.583=-0.175
σ0.079-0.188=-0.108
min27.338-27.410=-0.072
max27.479-27.782=-0.303