Compare commits

Home / Compare be8a585c .. ab916bf9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.993-36.727=-0.734
σ0.105-0.680=-0.576
min35.943-35.931=0.013
max36.290-37.528=-1.238
mean4121.000-3979.000=142.000
σ0.000
min4121.000-3979.000=142.000
max4121.000-3979.000=142.000
mean0.076-0.075=0.001
σ0.002-0.001=0.001
min0.075-0.074=0.000
max0.080-0.076=0.004
cache=y
dps=1
iters=10
policies=100
mean26.215-26.587=-0.372
σ0.005-0.606=-0.601
min26.208-26.207=0.001
max26.221-27.468=-1.247
mean4121.000-3979.000=142.000
σ0.000
min4121.000-3979.000=142.000
max4121.000-3979.000=142.000
mean0.061-0.061=0.000
σ0.001-0.001=0.000
min0.060-0.060=-0.000
max0.061-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.367=0.001
σ0.372-0.373=-0.001
min1755.802-1755.785=0.017
max1756.965-1756.961=0.004
mean1651.750-1657.100=-5.350
σ625.220-625.347=-0.128
min617.000-682.000=-65.000
max2713.000-2590.000=123.000
mean2.287-2.278=0.009
σ0.158-0.146=0.012
min2.125-2.119=0.006
max2.759-2.754=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.698-278.696=0.002
σ0.014-0.014=0.000
min278.684-278.683=0.001
max278.721-278.718=0.003
mean2713.000-2590.000=123.000
σ0.000
min2713.000-2590.000=123.000
max2713.000-2590.000=123.000
mean0.417-0.416=0.001
σ0.000-0.000=0.000
min0.417-0.415=0.001
max0.418-0.416=0.002
iters=5
new-facts=1
prior-facts=6402
mean2268.872-2268.876=-0.004
σ0.009-0.006=0.003
min2268.863-2268.870=-0.007
max2268.883-2268.884=-0.002
mean2713.000-2590.000=123.000
σ0.000
min2713.000-2590.000=123.000
max2713.000-2590.000=123.000
mean2.978-2.934=0.044
σ0.115-0.208=-0.093
min2.879-2.735=0.144
max3.152-3.283=-0.130
iters=5
new-facts=6402
prior-facts=1
mean4952.204-4952.211=-0.008
σ0.776-1.011=-0.236
min4951.788-4951.360=0.428
max4953.587-4953.963=-0.376
mean2713.000-2590.000=123.000
σ0.000
min2713.000-2590.000=123.000
max2713.000-2590.000=123.000
mean7.804-8.180=-0.375
σ0.177-0.411=-0.234
min7.641-7.774=-0.133
max8.089-8.815=-0.726
iters=5
new-facts=6402
prior-facts=6402
mean5166.851-5167.074=-0.224
σ0.164-0.014=0.149
min5166.558-5167.053=-0.495
max5166.938-5167.091=-0.153
mean3454.000-3415.600=38.400
σ476.927-457.655=19.271
min2834.000-2776.000=58.000
max4121.000-3979.000=142.000
mean9.359-9.292=0.066
σ0.226-0.205=0.022
min8.968-9.173=-0.205
max9.556-9.655=-0.099

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.094=-0.013
σ0.104-0.251=-0.146
min0.948-0.949=-0.000
max1.241-1.529=-0.287

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.261-460.257=0.004
σ572.608-572.607=0.001
min173.956-173.952=0.005
max1319.173-1319.167=0.006
mean79.500
σ7.000
min76.000
max90.000
mean438.000-437.000=1.000
σ0.000
min438.000-437.000=1.000
max438.000-437.000=1.000
mean0.548-0.572=-0.024
σ0.549-0.591=-0.043
min0.268-0.267=0.000
max1.371-1.459=-0.088
policies=20
mean1740.077-1740.050=0.028
σ0.326-0.337=-0.010
min1739.842-1739.805=0.037
max1740.556-1740.543=0.013
mean760.000
σ0.000
min760.000
max760.000
mean448.250-447.000=1.250
σ10.178-9.381=0.797
min438.000-437.000=1.000
max457.000-455.000=2.000
mean2.657-2.676=-0.019
σ0.019-0.018=0.000
min2.633-2.658=-0.025
max2.676-2.698=-0.022
policies=200
mean17410.035-17409.833=0.202
σ0.068-0.101=-0.033
min17409.982-17409.746=0.236
max17410.128-17409.969=0.159
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.000-490.250=1.750
σ3.559-2.062=1.497
min489.000-488.000=1.000
max497.000-492.000=5.000
mean26.854-26.914=-0.059
σ0.112-0.108=0.003
min26.733-26.792=-0.059
max26.977-27.030=-0.053