Compare commits

Home / Compare 59ed1694 .. 5c15e47e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.773=-0.004
σ0.048-0.047=0.002
min30.733-30.750=-0.017
max30.903-30.904=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.077-0.076=0.001
σ0.004-0.004=-0.000
min0.071-0.070=0.001
max0.084-0.082=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.001
σ0.002-0.003=-0.000
min21.056-21.056=0.001
max21.064-21.063=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.001
min0.063-0.062=0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.237=0.182
σ0.362-0.363=-0.000
min1750.847-1750.663=0.184
max1752.018-1751.840=0.177
mean1646.000-1648.450=-2.450
σ619.705-622.245=-2.540
min680.000-681.000=-1.000
max2638.000-2645.000=-7.000
mean2.801-2.829=-0.028
σ0.246-0.171=0.075
min2.311-2.311=-0.001
max3.144-3.026=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.757-275.540=0.217
σ0.010-0.006=0.004
min275.744-275.535=0.209
max275.767-275.549=0.218
mean2638.000-2645.000=-7.000
σ0.000
min2638.000-2645.000=-7.000
max2638.000-2645.000=-7.000
mean0.403-0.393=0.011
σ0.006-0.007=-0.001
min0.398-0.386=0.013
max0.412-0.403=0.009
iters=5
new-facts=1
prior-facts=6402
mean2168.288-2168.085=0.203
σ0.008-0.021=-0.014
min2168.275-2168.062=0.213
max2168.295-2168.104=0.191
mean2638.000-2645.000=-7.000
σ0.000
min2638.000-2645.000=-7.000
max2638.000-2645.000=-7.000
mean2.815-2.882=-0.067
σ0.049-0.149=-0.099
min2.764-2.700=0.064
max2.883-3.093=-0.209
iters=5
new-facts=6402
prior-facts=1
mean4889.240-5047.920=-158.679
σ355.516-0.915=354.601
min4253.275-5047.346=-794.071
max5049.692-5049.544=0.149
mean2638.000-2645.000=-7.000
σ0.000
min2638.000-2645.000=-7.000
max2638.000-2645.000=-7.000
mean8.711-8.767=-0.056
σ0.886-0.603=0.283
min7.218-8.095=-0.877
max9.595-9.484=0.110
iters=5
new-facts=6402
prior-facts=6402
mean5179.168-5179.035=0.133
σ0.193-0.089=0.104
min5178.847-5178.961=-0.113
max5179.328-5179.155=0.173
mean3154.800-3246.800=-92.000
σ458.114-517.208=-59.094
min2638.000-2645.000=-7.000
max3794.000-3970.000=-176.000
mean10.017-9.729=0.287
σ0.207-0.585=-0.377
min9.732-8.708=1.025
max10.315-10.194=0.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.217-1.205=0.012
σ0.418-0.366=0.052
min0.958-0.941=0.018
max1.922-1.818=0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.579-463.203=0.377
σ572.676-572.660=0.016
min177.237-176.871=0.367
max1322.594-1322.193=0.401
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2638.000-2645.000=-7.000
σ0.000
min2638.000-2645.000=-7.000
max2638.000-2645.000=-7.000
mean0.563-0.563=0.001
σ0.570-0.557=0.013
min0.269-0.276=-0.007
max1.418-1.398=0.020
policies=20
mean1772.606-1768.966=3.640
σ0.275-0.337=-0.062
min1772.417-1768.752=3.665
max1773.013-1769.469=3.544
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2638.000-2645.000=-7.000
σ0.000
min2638.000-2645.000=-7.000
max2638.000-2645.000=-7.000
mean2.753-2.738=0.015
σ0.010-0.023=-0.013
min2.740-2.718=0.022
max2.762-2.769=-0.007
policies=200
mean17732.901-17696.212=36.689
σ0.606-0.386=0.220
min17732.288-17695.969=36.318
max17733.736-17696.789=36.947
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2638.000-2645.000=-7.000
σ0.000
min2638.000-2645.000=-7.000
max2638.000-2645.000=-7.000
mean27.855-27.720=0.134
σ0.096-0.112=-0.016
min27.743-27.594=0.149
max27.968-27.857=0.111