Compare commits

Home / Compare 25cee94c .. a6d941ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.390=0.005
σ0.047-0.049=-0.001
min70.364-70.359=0.005
max70.523-70.526=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.160=-0.001
σ0.004-0.004=-0.001
min0.155-0.156=-0.002
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.000
σ0.002-0.003=-0.001
min21.143-21.141=0.002
max21.148-21.149=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.062=0.000
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.698-1752.393=0.305
σ0.363-0.361=0.001
min1752.122-1751.827=0.294
max1753.284-1752.989=0.295
mean1647.050-1654.800=-7.750
σ632.750-629.221=3.529
min619.000-617.000=2.000
max2769.000-2771.000=-2.000
mean2.812-2.842=-0.031
σ0.128-0.153=-0.026
min2.569-2.511=0.058
max3.123-3.117=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.611-270.140=0.471
σ0.006-0.009=-0.002
min270.601-270.128=0.472
max270.618-270.151=0.467
mean2769.000-2771.000=-2.000
σ0.000
min2769.000-2771.000=-2.000
max2769.000-2771.000=-2.000
mean0.379-0.378=0.001
σ0.004-0.005=-0.001
min0.377-0.372=0.005
max0.386-0.384=0.001
iters=5
new-facts=1
prior-facts=6402
mean1931.042-1930.609=0.434
σ0.009-0.008=0.001
min1931.035-1930.598=0.437
max1931.057-1930.619=0.438
mean2769.000-2771.000=-2.000
σ0.000
min2769.000-2771.000=-2.000
max2769.000-2771.000=-2.000
mean2.989-2.517=0.473
σ0.041-0.102=-0.061
min2.948-2.450=0.498
max3.052-2.691=0.361
iters=5
new-facts=6402
prior-facts=1
mean4751.804-4751.318=0.486
σ0.836-0.908=-0.072
min4751.221-4750.802=0.418
max4753.276-4752.933=0.343
mean2769.000-2771.000=-2.000
σ0.000
min2769.000-2771.000=-2.000
max2769.000-2771.000=-2.000
mean8.203-8.477=-0.274
σ0.629-0.526=0.103
min7.732-7.614=0.118
max9.172-9.000=0.173
iters=5
new-facts=6402
prior-facts=6402
mean4942.162-4941.695=0.467
σ0.147-0.154=-0.007
min4941.903-4941.423=0.481
max4942.258-4941.785=0.473
mean3037.400-3014.000=23.400
σ326.486-236.541=89.945
min2769.000-2771.000=-2.000
max3527.000-3328.000=199.000
mean8.459-8.626=-0.167
σ0.134-0.245=-0.111
min8.355-8.394=-0.039
max8.693-9.009=-0.316

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.107-1.088=0.019
σ0.255-0.142=0.113
min0.928-0.934=-0.007
max1.547-1.322=0.225

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.205-466.375=0.829
σ575.929-575.936=-0.007
min179.234-178.401=0.833
max1331.098-1330.280=0.818
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2769.000-2771.000=-2.000
σ0.000
min2769.000-2771.000=-2.000
max2769.000-2771.000=-2.000
mean0.477-0.440=0.037
σ0.386-0.304=0.082
min0.283-0.284=-0.002
max1.056-0.897=0.159
policies=20
mean1792.615-1784.323=8.292
σ0.359-0.316=0.043
min1792.394-1784.104=8.291
max1793.151-1784.782=8.369
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2769.000-2771.000=-2.000
σ0.000
min2769.000-2771.000=-2.000
max2769.000-2771.000=-2.000
mean2.781-2.824=-0.043
σ0.014-0.089=-0.076
min2.764-2.756=0.007
max2.797-2.954=-0.158
policies=200
mean17933.061-17849.642=83.419
σ0.461-0.512=-0.051
min17932.804-17849.353=83.451
max17933.752-17850.409=83.344
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2769.000-2771.000=-2.000
σ0.000
min2769.000-2771.000=-2.000
max2769.000-2771.000=-2.000
mean27.952-27.990=-0.039
σ0.130-0.198=-0.068
min27.797-27.843=-0.046
max28.090-28.283=-0.192