Compare commits

Home / Compare 94dbba6d .. bbed1dff

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.695=0.006
σ0.045-0.048=-0.004
min70.676-70.667=0.009
max70.824-70.830=-0.006
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.160-0.159=0.001
σ0.004-0.004=-0.000
min0.156-0.152=0.004
max0.167-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=0.000
σ0.003-0.003=0.000
min21.417-21.417=-0.001
max21.424-21.426=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.065=-0.001
σ0.002-0.002=-0.000
min0.063-0.064=-0.001
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.457=0.002
σ0.361-0.363=-0.002
min1753.891-1753.884=0.006
max1755.058-1755.038=0.020
mean1651.550-1670.850=-19.300
σ625.469-650.547=-25.078
min621.000-622.000=-1.000
max2645.000-2868.000=-223.000
mean2.801-2.788=0.012
σ0.214-0.129=0.085
min2.178-2.560=-0.382
max3.081-2.992=0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.901-271.903=-0.002
σ0.003-0.003=0.000
min271.897-271.901=-0.004
max271.904-271.907=-0.003
mean2645.000-2868.000=-223.000
σ0.000
min2645.000-2868.000=-223.000
max2645.000-2868.000=-223.000
mean0.371-0.374=-0.003
σ0.005-0.009=-0.005
min0.368-0.369=-0.001
max0.380-0.391=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1932.302-1932.292=0.010
σ0.012-0.009=0.003
min1932.288-1932.277=0.012
max1932.319-1932.299=0.020
mean2645.000-2868.000=-223.000
σ0.000
min2645.000-2868.000=-223.000
max2645.000-2868.000=-223.000
mean3.087-2.990=0.097
σ0.234-0.130=0.104
min2.747-2.795=-0.048
max3.389-3.156=0.233
iters=5
new-facts=6402
prior-facts=1
mean4753.102-4752.997=0.105
σ0.809-0.908=-0.100
min4752.531-4752.147=0.383
max4754.524-4754.549=-0.025
mean2645.000-2868.000=-223.000
σ0.000
min2645.000-2868.000=-223.000
max2645.000-2868.000=-223.000
mean8.191-8.136=0.054
σ0.762-0.352=0.410
min7.610-7.703=-0.094
max9.425-8.514=0.911
iters=5
new-facts=6402
prior-facts=6402
mean4943.516-4943.518=-0.002
σ0.011-0.011=0.000
min4943.497-4943.505=-0.008
max4943.526-4943.533=-0.007
mean2971.200-3063.400=-92.200
σ353.368-197.732=155.637
min2645.000-2868.000=-223.000
max3461.000-3333.000=128.000
mean8.531-8.613=-0.082
σ0.355-0.217=0.138
min8.357-8.414=-0.057
max9.165-8.872=0.293

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.245-1.031=0.213
σ0.331-0.138=0.193
min0.946-0.939=0.007
max1.774-1.261=0.513

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.059-473.077=-0.019
σ575.920-575.909=0.011
min185.094-185.113=-0.019
max1336.938-1336.940=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2645.000-2868.000=-223.000
σ0.000
min2645.000-2868.000=-223.000
max2645.000-2868.000=-223.000
mean0.560-0.459=0.101
σ0.540-0.299=0.241
min0.286-0.306=-0.020
max1.371-0.908=0.463
policies=20
mean1851.235-1851.445=-0.210
σ0.375-0.382=-0.007
min1850.971-1851.167=-0.195
max1851.787-1852.000=-0.213
mean840.000
σ0.000
min840.000
max840.000
mean2645.000-2868.000=-223.000
σ0.000
min2645.000-2868.000=-223.000
max2645.000-2868.000=-223.000
mean2.849-2.955=-0.106
σ0.016-0.018=-0.002
min2.829-2.934=-0.106
max2.862-2.972=-0.110
policies=200
mean18519.347-18519.761=-0.414
σ0.430-0.893=-0.463
min18518.985-18519.033=-0.048
max18519.970-18520.891=-0.921
mean8400.000
σ0.000
min8400.000
max8400.000
mean2645.000-2868.000=-223.000
σ0.000
min2645.000-2868.000=-223.000
max2645.000-2868.000=-223.000
mean28.718-29.109=-0.391
σ0.102-0.390=-0.288
min28.584-28.834=-0.250
max28.825-29.687=-0.863