Compare commits

Home / Compare ec8dbb32 .. a0ceb94f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.050-0.048=0.001
min33.949-33.952=-0.003
max34.117-34.112=0.004
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.085-0.083=0.002
σ0.004-0.005=-0.001
min0.081-0.077=0.004
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.311-23.317=-0.006
σ0.005-0.002=0.003
min23.306-23.313=-0.007
max23.324-23.320=0.004
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.039-0.064=-0.024
σ0.009-0.004=0.005
min0.035-0.060=-0.025
max0.064-0.071=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.431-1757.429=0.001
σ0.364-0.367=-0.002
min1756.855-1756.854=0.001
max1758.023-1758.025=-0.003
mean1662.050-1646.650=15.400
σ627.874-625.352=2.522
min666.000-636.000=30.000
max2610.000-2835.000=-225.000
mean2.392-2.360=0.032
σ0.150-0.080=0.070
min2.250-2.202=0.048
max2.858-2.568=0.290

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.543-326.575=-0.032
σ0.047-0.046=0.002
min326.460-326.496=-0.036
max326.578-326.611=-0.033
mean2610.000-2835.000=-225.000
σ0.000
min2610.000-2835.000=-225.000
max2610.000-2835.000=-225.000
mean0.426-0.423=0.003
σ0.006-0.002=0.004
min0.421-0.421=0.001
max0.433-0.426=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.744-1848.399=140.345
σ0.007-313.801=-313.793
min1988.733-1287.055=701.677
max1988.753-1988.741=0.012
mean2610.000-2835.000=-225.000
σ0.000
min2610.000-2835.000=-225.000
max2610.000-2835.000=-225.000
mean2.617-2.618=-0.001
σ0.085-0.479=-0.395
min2.509-1.801=0.707
max2.724-3.005=-0.280
iters=5
new-facts=6402
prior-facts=1
mean4813.510-4813.514=-0.004
σ7.797-7.783=0.014
min4809.627-4809.675=-0.048
max4827.450-4827.431=0.018
mean2610.000-2835.000=-225.000
σ0.000
min2610.000-2835.000=-225.000
max2610.000-2835.000=-225.000
mean8.560-8.324=0.236
σ0.663-0.539=0.124
min7.721-7.799=-0.077
max9.582-9.180=0.402
iters=5
new-facts=6402
prior-facts=6402
mean5001.140-5001.072=0.068
σ0.021-0.176=-0.155
min5001.115-5000.759=0.356
max5001.162-5001.179=-0.017
mean2974.200-3000.200=-26.000
σ279.850-242.765=37.086
min2610.000-2835.000=-225.000
max3319.000-3392.000=-73.000
mean9.714-9.741=-0.027
σ0.102-0.162=-0.060
min9.567-9.539=0.029
max9.852-9.983=-0.131

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.334-0.940=0.394
σ0.328-0.057=0.271
min1.041-0.898=0.143
max1.801-1.040=0.761

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.558-464.563=-0.005
σ574.775-574.771=0.004
min177.167-177.173=-0.006
max1326.721-1326.720=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2610.000-2835.000=-225.000
σ0.000
min2610.000-2835.000=-225.000
max2610.000-2835.000=-225.000
mean0.545-0.439=0.106
σ0.543-0.307=0.236
min0.265-0.279=-0.014
max1.360-0.900=0.460
policies=20
mean1771.992-1772.073=-0.081
σ0.278-0.360=-0.082
min1771.792-1771.825=-0.033
max1772.403-1772.605=-0.203
mean840.000
σ0.000
min840.000
max840.000
mean2610.000-2835.000=-225.000
σ0.000
min2610.000-2835.000=-225.000
max2610.000-2835.000=-225.000
mean2.721-2.792=-0.071
σ0.039-0.014=0.025
min2.694-2.773=-0.079
max2.778-2.804=-0.027
policies=200
mean17727.363-17727.543=-0.179
σ0.797-0.560=0.238
min17726.395-17727.155=-0.761
max17728.344-17728.374=-0.030
mean8400.000
σ0.000
min8400.000
max8400.000
mean2610.000-2835.000=-225.000
σ0.000
min2610.000-2835.000=-225.000
max2610.000-2835.000=-225.000
mean27.429-27.912=-0.482
σ0.065-0.446=-0.381
min27.341-27.546=-0.205
max27.493-28.456=-0.963