Compare commits

Home / Compare 45a0c9e8 .. 8bdc2d7a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.957-30.769=0.189
σ0.051-0.048=0.003
min30.914-30.728=0.186
max31.099-30.901=0.198
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.078-0.078=-0.000
σ0.003-0.003=-0.000
min0.075-0.072=0.003
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.001
σ0.002-0.002=0.000
min21.055-21.054=0.001
max21.064-21.064=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.060-0.060=0.000
σ0.005-0.004=0.001
min0.056-0.056=0.000
max0.070-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.419=-0.008
σ0.362-0.362=-0.001
min1750.843-1750.854=-0.011
max1752.001-1752.002=-0.001
mean1651.600-1649.050=2.550
σ646.935-622.142=24.794
min646.000-679.000=-33.000
max2847.000-2649.000=198.000
mean2.795-2.823=-0.028
σ0.160-0.166=-0.006
min2.344-2.277=0.067
max3.151-3.002=0.149

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.398-275.757=-2.359
σ0.007-0.011=-0.004
min273.390-275.744=-2.354
max273.408-275.769=-2.360
mean2847.000-2649.000=198.000
σ0.000
min2847.000-2649.000=198.000
max2847.000-2649.000=198.000
mean0.385-0.401=-0.016
σ0.011-0.009=0.002
min0.376-0.394=-0.018
max0.401-0.415=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.830-2168.274=-234.444
σ0.012-0.036=-0.023
min1933.811-2168.213=-234.403
max1933.842-2168.302=-234.461
mean2847.000-2649.000=198.000
σ0.000
min2847.000-2649.000=198.000
max2847.000-2649.000=198.000
mean3.136-2.986=0.150
σ0.115-0.114=0.001
min3.000-2.788=0.212
max3.306-3.078=0.228
iters=5
new-facts=6402
prior-facts=1
mean4754.347-5048.098=-293.751
σ0.801-0.963=-0.162
min4753.887-5047.515=-293.628
max4755.773-5049.805=-294.031
mean2847.000-2649.000=198.000
σ0.000
min2847.000-2649.000=198.000
max2847.000-2649.000=198.000
mean8.575-8.939=-0.364
σ0.300-0.489=-0.189
min8.189-8.178=0.012
max8.956-9.376=-0.419
iters=5
new-facts=6402
prior-facts=6402
mean4944.737-5179.248=-234.511
σ0.122-0.075=0.047
min4944.559-5179.179=-234.620
max4944.902-5179.341=-234.439
mean3112.800-3236.400=-123.600
σ255.826-379.104=-123.278
min2847.000-2702.000=145.000
max3372.000-3695.000=-323.000
mean8.651-10.064=-1.413
σ0.204-0.319=-0.115
min8.440-9.549=-1.109
max8.954-10.412=-1.459

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-1.106=-0.028
σ0.254-0.180=0.074
min0.933-0.936=-0.002
max1.523-1.344=0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.346-463.576=-0.230
σ572.208-572.677=-0.469
min177.232-177.235=-0.003
max1321.657-1322.591=-0.934
mean79.750
σ7.500
min76.000
max91.000
mean2847.000-2649.000=198.000
σ0.000
min2847.000-2649.000=198.000
max2847.000-2649.000=198.000
mean0.438-0.560=-0.122
σ0.302-0.562=-0.261
min0.283-0.276=0.007
max0.890-1.403=-0.513
policies=20
mean1772.627-1772.618=0.008
σ0.336-0.327=0.009
min1772.373-1772.394=-0.020
max1773.117-1773.103=0.014
mean760.000
σ0.000
min760.000
max760.000
mean2847.000-2649.000=198.000
σ0.000
min2847.000-2649.000=198.000
max2847.000-2649.000=198.000
mean2.829-2.743=0.086
σ0.005-0.007=-0.003
min2.825-2.733=0.093
max2.835-2.750=0.086
policies=200
mean17732.467-17733.021=-0.554
σ0.383-0.503=-0.120
min17732.121-17732.696=-0.575
max17733.015-17733.771=-0.756
mean7600.000
σ0.000
min7600.000
max7600.000
mean2847.000-2649.000=198.000
σ0.000
min2847.000-2649.000=198.000
max2847.000-2649.000=198.000
mean28.154-27.764=0.390
σ0.468-0.192=0.276
min27.617-27.532=0.085
max28.551-27.997=0.554