Compare commits

Home / Compare 7c0ea859 .. 8f67bbb9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.395=0.171
σ0.045-0.047=-0.002
min70.537-70.364=0.173
max70.690-70.523=0.167
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.159-0.159=0.000
σ0.003-0.004=-0.000
min0.154-0.155=-0.000
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.286-21.145=0.141
σ0.002-0.002=0.000
min21.283-21.143=0.140
max21.291-21.148=0.142
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.060-0.064=-0.004
σ0.003-0.002=0.000
min0.058-0.063=-0.005
max0.067-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.377-1752.698=0.679
σ0.361-0.363=-0.002
min1752.803-1752.122=0.682
max1753.956-1753.284=0.672
mean1663.300-1647.050=16.250
σ633.864-632.750=1.113
min616.000-619.000=-3.000
max2766.000-2769.000=-3.000
mean2.801-2.812=-0.011
σ0.168-0.128=0.040
min2.265-2.569=-0.304
max3.064-3.123=-0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-270.611=1.142
σ0.005-0.006=-0.002
min271.747-270.601=1.147
max271.760-270.618=1.142
mean2766.000-2769.000=-3.000
σ0.000
min2766.000-2769.000=-3.000
max2766.000-2769.000=-3.000
mean0.378-0.379=-0.001
σ0.002-0.004=-0.001
min0.375-0.377=-0.002
max0.381-0.386=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1931.042=1.136
σ0.011-0.009=0.002
min1932.165-1931.035=1.131
max1932.196-1931.057=1.139
mean2766.000-2769.000=-3.000
σ0.000
min2766.000-2769.000=-3.000
max2766.000-2769.000=-3.000
mean2.982-2.989=-0.008
σ0.186-0.041=0.145
min2.764-2.948=-0.184
max3.266-3.052=0.214
iters=5
new-facts=6402
prior-facts=1
mean4752.913-4751.804=1.109
σ0.849-0.836=0.013
min4752.414-4751.221=1.193
max4754.421-4753.276=1.145
mean2766.000-2769.000=-3.000
σ0.000
min2766.000-2769.000=-3.000
max2766.000-2769.000=-3.000
mean8.441-8.203=0.238
σ0.518-0.629=-0.111
min7.610-7.732=-0.122
max8.947-9.172=-0.225
iters=5
new-facts=6402
prior-facts=6402
mean4943.381-4942.162=1.220
σ0.015-0.147=-0.132
min4943.361-4941.903=1.458
max4943.396-4942.258=1.138
mean3046.600-3037.400=9.200
σ242.591-326.486=-83.895
min2766.000-2769.000=-3.000
max3395.000-3527.000=-132.000
mean8.807-8.459=0.349
σ0.254-0.134=0.120
min8.468-8.355=0.113
max9.181-8.693=0.489

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.107=-0.111
σ0.136-0.255=-0.119
min0.931-0.928=0.004
max1.239-1.547=-0.307

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.857-467.205=0.652
σ575.928-575.929=-0.001
min179.888-179.234=0.655
max1331.749-1331.098=0.650
mean86.250
σ8.500
min82.000
max99.000
mean2766.000-2769.000=-3.000
σ0.000
min2766.000-2769.000=-3.000
max2766.000-2769.000=-3.000
mean0.440-0.477=-0.038
σ0.307-0.386=-0.078
min0.281-0.283=-0.002
max0.901-1.056=-0.155
policies=20
mean1799.131-1792.615=6.516
σ0.253-0.359=-0.107
min1798.936-1792.394=6.541
max1799.501-1793.151=6.350
mean820.000
σ0.000
min820.000
max820.000
mean2766.000-2769.000=-3.000
σ0.000
min2766.000-2769.000=-3.000
max2766.000-2769.000=-3.000
mean2.864-2.781=0.083
σ0.082-0.014=0.069
min2.796-2.764=0.033
max2.979-2.797=0.182
policies=200
mean17998.244-17933.061=65.183
σ0.918-0.461=0.456
min17997.061-17932.804=64.257
max17999.301-17933.752=65.549
mean8200.000
σ0.000
min8200.000
max8200.000
mean2766.000-2769.000=-3.000
σ0.000
min2766.000-2769.000=-3.000
max2766.000-2769.000=-3.000
mean28.264-27.952=0.312
σ0.107-0.130=-0.024
min28.175-27.797=0.378
max28.417-28.090=0.327