Compare commits

Home / Compare efcb3adf .. 3884ec65

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.049=-0.001
min33.956-33.947=0.009
max34.116-34.114=0.001
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.086-0.082=0.004
σ0.004-0.004=-0.000
min0.083-0.077=0.006
max0.093-0.090=0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.002-0.003=-0.001
min23.315-23.313=0.002
max23.321-23.322=-0.001
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.065-0.064=0.001
σ0.003-0.002=0.000
min0.063-0.061=0.002
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.429=0.064
σ0.363-0.365=-0.002
min1756.921-1756.854=0.067
max1758.082-1758.020=0.062
mean1668.250-1650.900=17.350
σ625.897-625.046=0.850
min660.000-675.000=-15.000
max2695.000-2592.000=103.000
mean2.372-2.350=0.022
σ0.116-0.116=0.000
min2.242-2.090=0.152
max2.723-2.563=0.159

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.634-326.561=0.073
σ0.048-0.063=-0.014
min326.548-326.449=0.099
max326.662-326.595=0.066
mean2695.000-2592.000=103.000
σ0.000
min2695.000-2592.000=103.000
max2695.000-2592.000=103.000
mean0.426-0.428=-0.002
σ0.005-0.015=-0.009
min0.420-0.417=0.003
max0.431-0.454=-0.023
iters=5
new-facts=1
prior-facts=6402
mean1988.785-1988.740=0.045
σ0.010-0.009=0.001
min1988.768-1988.731=0.037
max1988.795-1988.750=0.045
mean2695.000-2592.000=103.000
σ0.000
min2695.000-2592.000=103.000
max2695.000-2592.000=103.000
mean2.725-2.689=0.036
σ0.179-0.056=0.123
min2.583-2.651=-0.068
max3.009-2.786=0.223
iters=5
new-facts=6402
prior-facts=1
mean4813.548-4813.548=-0.001
σ7.797-7.784=0.013
min4809.595-4809.578=0.016
max4827.487-4827.459=0.027
mean2695.000-2592.000=103.000
σ0.000
min2695.000-2592.000=103.000
max2695.000-2592.000=103.000
mean8.492-8.963=-0.470
σ0.587-0.777=-0.190
min7.952-7.696=0.257
max9.316-9.762=-0.446
iters=5
new-facts=6402
prior-facts=6402
mean5001.137-5001.140=-0.003
σ0.181-0.025=0.156
min5000.818-5001.114=-0.296
max5001.262-5001.176=0.086
mean3009.000-2961.600=47.400
σ361.517-266.050=95.467
min2695.000-2614.000=81.000
max3533.000-3305.000=228.000
mean9.829-9.805=0.024
σ0.222-0.137=0.085
min9.659-9.633=0.026
max10.215-10.010=0.204

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.305=-0.228
σ0.285-0.311=-0.026
min0.908-0.926=-0.018
max1.577-1.638=-0.060

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.630-464.560=0.069
σ574.781-574.777=0.004
min177.235-177.170=0.066
max1326.802-1326.726=0.076
mean88.250
σ8.500
min84.000
max101.000
mean2695.000-2592.000=103.000
σ0.000
min2695.000-2592.000=103.000
max2695.000-2592.000=103.000
mean0.557-0.562=-0.005
σ0.571-0.583=-0.011
min0.269-0.269=-0.001
max1.414-1.436=-0.022
policies=20
mean1772.664-1772.018=0.645
σ0.352-0.349=0.003
min1772.420-1771.779=0.642
max1773.185-1772.537=0.649
mean840.000
σ0.000
min840.000
max840.000
mean2695.000-2592.000=103.000
σ0.000
min2695.000-2592.000=103.000
max2695.000-2592.000=103.000
mean2.714-2.701=0.013
σ0.022-0.012=0.010
min2.691-2.688=0.003
max2.744-2.713=0.031
policies=200
mean17733.947-17727.631=6.317
σ0.479-0.502=-0.023
min17733.700-17727.359=6.340
max17734.666-17728.383=6.282
mean8400.000
σ0.000
min8400.000
max8400.000
mean2695.000-2592.000=103.000
σ0.000
min2695.000-2592.000=103.000
max2695.000-2592.000=103.000
mean27.542-27.439=0.103
σ0.212-0.188=0.024
min27.346-27.245=0.101
max27.767-27.694=0.072