Compare commits

Home / Compare 3140750c .. 6de46ad9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.991-35.993=-0.002
σ0.104-0.103=0.001
min35.943-35.946=-0.003
max36.286-36.285=0.001
mean4100.000-3984.000=116.000
σ0.000
min4100.000-3984.000=116.000
max4100.000-3984.000=116.000
mean0.074-0.075=-0.001
σ0.002-0.001=0.002
min0.070-0.074=-0.004
max0.077-0.076=0.002
cache=y
dps=1
iters=10
policies=100
mean26.214-26.214=-0.001
σ0.004-0.004=-0.000
min26.208-26.206=0.003
max26.221-26.219=0.001
mean4100.000-3984.000=116.000
σ0.000
min4100.000-3984.000=116.000
max4100.000-3984.000=116.000
mean0.060-0.060=0.000
σ0.001-0.001=-0.000
min0.060-0.059=0.001
max0.061-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.367=0.002
σ0.374-0.372=0.002
min1755.790-1755.788=0.002
max1756.966-1756.967=-0.001
mean1650.300-1660.150=-9.850
σ633.410-627.837=5.573
min617.000-619.000=-2.000
max2598.000-2640.000=-42.000
mean2.323-2.295=0.028
σ0.193-0.178=0.015
min2.086-2.145=-0.059
max2.779-2.774=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.693=0.005
σ0.014-0.013=0.001
min278.683-278.683=0.001
max278.720-278.714=0.006
mean2598.000-2640.000=-42.000
σ0.000
min2598.000-2640.000=-42.000
max2598.000-2640.000=-42.000
mean0.419-0.417=0.002
σ0.001-0.002=-0.001
min0.418-0.415=0.003
max0.420-0.419=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.864-2268.865=-0.000
σ0.010-0.006=0.004
min2268.849-2268.857=-0.008
max2268.873-2268.873=-0.000
mean2598.000-2640.000=-42.000
σ0.000
min2598.000-2640.000=-42.000
max2598.000-2640.000=-42.000
mean2.990-2.977=0.013
σ0.132-0.171=-0.040
min2.865-2.880=-0.016
max3.207-3.282=-0.075
iters=5
new-facts=6402
prior-facts=1
mean4952.180-4952.211=-0.030
σ0.832-0.783=0.049
min4951.739-4951.814=-0.075
max4953.666-4953.611=0.055
mean2598.000-2640.000=-42.000
σ0.000
min2598.000-2640.000=-42.000
max2598.000-2640.000=-42.000
mean8.025-7.876=0.149
σ0.272-0.188=0.084
min7.686-7.682=0.004
max8.427-8.170=0.258
iters=5
new-facts=6402
prior-facts=6402
mean5166.850-5166.839=0.011
σ0.160-0.162=-0.002
min5166.566-5166.550=0.016
max5166.940-5166.926=0.013
mean3432.000-3413.600=18.400
σ473.541-466.865=6.677
min2822.000-2758.000=64.000
max4100.000-3984.000=116.000
mean9.259-9.461=-0.202
σ0.458-0.230=0.228
min8.491-9.051=-0.559
max9.604-9.587=0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.027=0.064
σ0.106-0.187=-0.081
min0.958-0.927=0.030
max1.255-1.362=-0.107

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.258=0.001
σ572.608-572.607=0.000
min173.954-173.953=0.001
max1319.170-1319.169=0.001
mean79.500
σ7.000
min76.000
max90.000
mean437.000-435.000=2.000
σ0.000
min437.000-435.000=2.000
max437.000-435.000=2.000
mean0.552-0.550=0.002
σ0.548-0.549=-0.002
min0.272-0.273=-0.001
max1.373-1.374=-0.001
policies=20
mean1740.041-1740.041=0.000
σ0.328-0.328=-0.000
min1739.808-1739.805=0.002
max1740.522-1740.522=-0.000
mean760.000
σ0.000
min760.000
max760.000
mean447.000-445.000=2.000
σ9.381
min437.000-435.000=2.000
max455.000-453.000=2.000
mean2.669-2.665=0.003
σ0.008-0.004=0.004
min2.657-2.659=-0.003
max2.674-2.669=0.005
policies=200
mean17409.689-17409.862=-0.173
σ0.060-0.082=-0.022
min17409.617-17409.746=-0.129
max17409.740-17409.937=-0.196
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.000-490.250=1.750
σ2.309-3.775=-1.466
min490.000-486.000=4.000
max494.000-495.000=-1.000
mean26.997-26.906=0.091
σ0.166-0.134=0.032
min26.827-26.745=0.082
max27.211-27.028=0.183