Compare commits

Home / Compare 743c53e3 .. 333df966

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.566=0.215
σ0.051-0.047=0.004
min70.754-70.534=0.221
max70.925-70.696=0.229
mean413.000-411.100=1.900
σ0.000-0.316=-0.316
min413.000-411.000=2.000
max413.000-412.000=1.000
mean0.161-0.159=0.001
σ0.003-0.005=-0.002
min0.157-0.151=0.006
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.494-21.288=0.206
σ0.002-0.003=-0.001
min21.490-21.284=0.206
max21.496-21.293=0.203
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.002
min0.063-0.060=0.003
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1753.569=-1.688
σ0.360-0.360=-0.000
min1751.318-1752.993=-1.675
max1752.467-1754.154=-1.687
mean1633.250-1651.650=-18.400
σ625.111-638.069=-12.958
min618.000-620.000=-2.000
max2766.000-2846.000=-80.000
mean2.856-2.797=0.059
σ0.194-0.212=-0.018
min2.260-2.210=0.050
max3.123-2.998=0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.379-271.993=-2.614
σ0.005-0.008=-0.003
min269.371-271.985=-2.614
max269.383-272.004=-2.621
mean2766.000-2846.000=-80.000
σ0.000
min2766.000-2846.000=-80.000
max2766.000-2846.000=-80.000
mean0.376-0.394=-0.018
σ0.004-0.014=-0.009
min0.374-0.381=-0.007
max0.384-0.415=-0.031
iters=5
new-facts=1
prior-facts=6402
mean1929.741-1932.433=-2.692
σ0.016-0.014=0.002
min1929.720-1932.417=-2.697
max1929.758-1932.449=-2.691
mean2766.000-2846.000=-80.000
σ0.000
min2766.000-2846.000=-80.000
max2766.000-2846.000=-80.000
mean2.937-2.951=-0.014
σ0.261-0.311=-0.050
min2.478-2.470=0.008
max3.104-3.339=-0.234
iters=5
new-facts=6402
prior-facts=1
mean4750.504-4752.864=-2.359
σ0.856-1.139=-0.283
min4750.078-4751.514=-1.436
max4752.035-4754.647=-2.612
mean2766.000-2846.000=-80.000
σ0.000
min2766.000-2846.000=-80.000
max2766.000-2846.000=-80.000
mean8.479-8.220=0.259
σ0.343-0.684=-0.341
min7.894-7.687=0.206
max8.784-9.289=-0.505
iters=5
new-facts=6402
prior-facts=6402
mean4940.986-4943.628=-2.643
σ0.010-0.021=-0.011
min4940.972-4943.608=-2.636
max4940.994-4943.658=-2.664
mean2987.600-3074.400=-86.800
σ221.213-299.757=-78.544
min2766.000-2846.000=-80.000
max3309.000-3535.000=-226.000
mean8.423-8.423=0.000
σ0.098-0.114=-0.016
min8.348-8.313=0.034
max8.579-8.571=0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.080-1.155=-0.075
σ0.113-0.267=-0.154
min0.938-0.927=0.011
max1.254-1.534=-0.280

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.712-473.085=-10.373
σ574.961-575.926=-0.965
min175.221-185.113=-9.892
max1325.154-1336.973=-11.820
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2766.000-2846.000=-80.000
σ0.000
min2766.000-2846.000=-80.000
max2766.000-2846.000=-80.000
mean0.504-0.451=0.053
σ0.447-0.299=0.147
min0.277-0.300=-0.022
max1.174-0.900=0.274
policies=20
mean1752.488-1851.465=-98.977
σ0.362-0.377=-0.015
min1752.257-1851.181=-98.924
max1753.027-1852.012=-98.985
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2766.000-2846.000=-80.000
σ0.000
min2766.000-2846.000=-80.000
max2766.000-2846.000=-80.000
mean2.734-2.951=-0.217
σ0.012-0.010=0.001
min2.722-2.936=-0.214
max2.746-2.958=-0.212
policies=200
mean17532.198-18521.074=-988.876
σ0.410-0.471=-0.061
min17531.836-18520.721=-988.886
max17532.787-18521.747=-988.960
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2766.000-2846.000=-80.000
σ0.000
min2766.000-2846.000=-80.000
max2766.000-2846.000=-80.000
mean27.465-29.200=-1.735
σ0.156-0.473=-0.316
min27.306-28.758=-1.452
max27.673-29.823=-2.150