Compare commits

Home / Compare dcf62ef2 .. 58f75523

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.649=-0.002
σ0.365-0.364=0.001
min53.515-53.521=-0.006
max54.686-54.685=0.001
mean414.000-418.600=-4.600
σ0.000-0.516=-0.516
min414.000-418.000=-4.000
max414.000-419.000=-5.000
mean0.139-0.140=-0.001
σ0.003-0.004=-0.000
min0.135-0.136=-0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.942-42.941=0.000
σ0.007-0.006=0.002
min42.930-42.933=-0.004
max42.956-42.953=0.003
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.121-0.121=-0.001
σ0.004-0.003=0.001
min0.117-0.119=-0.002
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.866-991.864=0.002
σ1.188-1.210=-0.021
min991.331-991.331=0.001
max996.851-996.929=-0.078
mean1063.050-1059.850=3.200
σ320.230-313.143=7.088
min605.000-592.000=13.000
max1643.000-1534.000=109.000
mean1.517-1.516=0.001
σ0.070-0.061=0.009
min1.458-1.453=0.004
max1.749-1.648=0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.436=-0.000
σ0.015-0.012=0.003
min285.413-285.423=-0.010
max285.453-285.451=0.002
mean1643.000-1534.000=109.000
σ0.000
min1643.000-1534.000=109.000
max1643.000-1534.000=109.000
mean0.376-0.379=-0.003
σ0.002-0.005=-0.004
min0.374-0.375=-0.001
max0.378-0.388=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1285.516-1285.465=0.051
σ0.090-0.073=0.017
min1285.356-1285.357=-0.001
max1285.574-1285.537=0.038
mean1643.000-1534.000=109.000
σ0.000
min1643.000-1534.000=109.000
max1643.000-1534.000=109.000
mean2.030-1.883=0.146
σ0.255-0.181=0.074
min1.810-1.687=0.123
max2.429-2.170=0.259
iters=5
new-facts=6402
prior-facts=1
mean1705.820-1705.829=-0.009
σ6.851-6.849=0.002
min1702.608-1702.644=-0.036
max1718.070-1718.078=-0.008
mean1643.000-1534.000=109.000
σ0.000
min1643.000-1534.000=109.000
max1643.000-1534.000=109.000
mean3.100-2.913=0.187
σ0.265-0.258=0.007
min2.753-2.560=0.193
max3.355-3.177=0.177
iters=5
new-facts=6402
prior-facts=6402
mean1968.414-1968.451=-0.037
σ0.026-0.015=0.011
min1968.369-1968.436=-0.067
max1968.436-1968.471=-0.035
mean1801.800-1855.200=-53.400
σ165.972-233.318=-67.346
min1643.000-1567.000=76.000
max2036.000-2139.000=-103.000
mean3.340-3.264=0.076
σ0.371-0.112=0.259
min3.076-3.148=-0.073
max3.994-3.429=0.565

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.533=-0.351
σ0.281-0.232=0.050
min0.915-1.231=-0.315
max1.605-1.836=-0.231

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.775-436.769=0.005
σ572.364-572.351=0.012
min150.590-150.587=0.003
max1295.320-1295.296=0.024
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1534.000=109.000
σ0.000
min1643.000-1534.000=109.000
max1643.000-1534.000=109.000
mean0.530-0.533=-0.003
σ0.564-0.558=0.006
min0.248-0.251=-0.003
max1.376-1.369=0.007
policies=20
mean1506.182-1506.155=0.028
σ0.258-0.245=0.013
min1506.015-1505.990=0.024
max1506.566-1506.518=0.048
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1534.000=109.000
σ0.000
min1643.000-1534.000=109.000
max1643.000-1534.000=109.000
mean2.551-2.525=0.027
σ0.068-0.018=0.050
min2.481-2.502=-0.022
max2.643-2.540=0.103
policies=200
mean15069.338-15069.474=-0.136
σ0.084-0.115=-0.031
min15069.246-15069.367=-0.121
max15069.447-15069.594=-0.147
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1534.000=109.000
σ0.000
min1643.000-1534.000=109.000
max1643.000-1534.000=109.000
mean25.430-25.490=-0.060
σ0.115-0.114=0.001
min25.284-25.387=-0.104
max25.524-25.619=-0.095