Compare commits

Home / Compare f18fd99b .. 72d92d5c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.951-35.951=0.000
σ0.101-0.102=-0.000
min35.908-35.906=0.003
max36.238-36.239=-0.001
mean415.000-411.900=3.100
σ0.000-0.316=-0.316
min415.000-411.000=4.000
max415.000-412.000=3.000
mean0.079-0.076=0.003
σ0.005-0.003=0.002
min0.075-0.072=0.004
max0.087-0.084=0.003
cache=y
dps=1
iters=10
policies=100
mean26.200-26.200=-0.000
σ0.005-0.004=0.001
min26.193-26.194=-0.001
max26.210-26.207=0.004
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.061-0.060=0.002
σ0.003-0.003=0.000
min0.060-0.057=0.002
max0.070-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.300-1756.300=0.000
σ0.369-0.369=0.001
min1755.721-1755.720=0.001
max1756.891-1756.891=0.000
mean1679.000-1654.150=24.850
σ636.673-629.723=6.950
min681.000-678.000=3.000
max2692.000-2606.000=86.000
mean2.334-2.321=0.012
σ0.077-0.080=-0.002
min2.188-2.183=0.005
max2.497-2.504=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.816-278.814=0.002
σ0.004-0.007=-0.003
min278.812-278.806=0.006
max278.821-278.823=-0.002
mean2692.000-2606.000=86.000
σ0.000
min2692.000-2606.000=86.000
max2692.000-2606.000=86.000
mean0.411-0.413=-0.002
σ0.005-0.004=0.001
min0.407-0.410=-0.003
max0.419-0.418=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.874-2268.880=-0.006
σ0.015-0.015=-0.000
min2268.852-2268.865=-0.013
max2268.892-2268.895=-0.003
mean2692.000-2606.000=86.000
σ0.000
min2692.000-2606.000=86.000
max2692.000-2606.000=86.000
mean2.952-2.950=0.002
σ0.110-0.217=-0.107
min2.880-2.616=0.263
max3.148-3.157=-0.008
iters=5
new-facts=6402
prior-facts=1
mean4954.215-4954.264=-0.049
σ0.807-0.902=-0.095
min4953.726-4953.730=-0.004
max4955.641-4955.867=-0.227
mean2692.000-2606.000=86.000
σ0.000
min2692.000-2606.000=86.000
max2692.000-2606.000=86.000
mean8.048-8.046=0.002
σ0.206-0.601=-0.395
min7.738-7.588=0.151
max8.232-9.090=-0.858
iters=5
new-facts=6402
prior-facts=6402
mean5168.784-5168.786=-0.002
σ0.085-0.077=0.007
min5168.719-5168.722=-0.003
max5168.878-5168.876=0.001
mean3376.400-3436.400=-60.000
σ450.816-502.146=-51.330
min2773.000-2846.000=-73.000
max3964.000-4176.000=-212.000
mean9.177-9.362=-0.184
σ0.215-0.194=0.021
min8.842-9.143=-0.301
max9.428-9.660=-0.232

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.112-1.342=-0.230
σ0.237-0.441=-0.204
min0.942-0.927=0.015
max1.461-1.840=-0.380

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.811-459.804=0.007
σ571.587-571.591=-0.004
min174.009-174.005=0.003
max1317.191-1317.190=0.001
mean79.500
σ7.000
min76.000
max90.000
mean2692.000-2606.000=86.000
σ0.000
min2692.000-2606.000=86.000
max2692.000-2606.000=86.000
mean0.552-0.545=0.007
σ0.569-0.557=0.012
min0.264-0.261=0.002
max1.406-1.381=0.025
policies=20
mean1740.317-1740.301=0.016
σ0.329-0.315=0.014
min1740.098-1740.108=-0.010
max1740.806-1740.771=0.035
mean760.000
σ0.000
min760.000
max760.000
mean2692.000-2606.000=86.000
σ0.000
min2692.000-2606.000=86.000
max2692.000-2606.000=86.000
mean2.695-2.680=0.015
σ0.009-0.015=-0.006
min2.687-2.665=0.022
max2.703-2.700=0.003
policies=200
mean17410.162-17410.089=0.074
σ0.457-0.435=0.022
min17409.896-17409.755=0.141
max17410.845-17410.725=0.120
mean7600.000
σ0.000
min7600.000
max7600.000
mean2692.000-2606.000=86.000
σ0.000
min2692.000-2606.000=86.000
max2692.000-2606.000=86.000
mean27.040-27.016=0.024
σ0.092-0.117=-0.025
min26.935-26.850=0.086
max27.156-27.110=0.046