Compare commits

Home / Compare 0da7a425 .. 7c0ea859

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.393=0.002
σ0.047-0.046=0.002
min70.364-70.371=-0.007
max70.523-70.522=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.160=-0.001
σ0.004-0.003=0.001
min0.155-0.156=-0.002
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.003=-0.002
min21.143-21.137=0.006
max21.148-21.148=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.064=0.000
σ0.002-0.003=-0.000
min0.063-0.062=0.000
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.698-1752.394=0.303
σ0.363-0.362=0.001
min1752.122-1751.828=0.293
max1753.284-1752.977=0.307
mean1647.050-1660.550=-13.500
σ632.750-637.810=-5.059
min619.000-625.000=-6.000
max2769.000-2814.000=-45.000
mean2.812-2.791=0.021
σ0.128-0.136=-0.008
min2.569-2.495=0.074
max3.123-3.083=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.611-270.238=0.373
σ0.006-0.009=-0.003
min270.601-270.224=0.377
max270.618-270.246=0.372
mean2769.000-2814.000=-45.000
σ0.000
min2769.000-2814.000=-45.000
max2769.000-2814.000=-45.000
mean0.379-0.382=-0.003
σ0.004-0.008=-0.005
min0.377-0.374=0.003
max0.386-0.396=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1931.042-1930.707=0.336
σ0.009-0.006=0.003
min1931.035-1930.698=0.337
max1931.057-1930.714=0.342
mean2769.000-2814.000=-45.000
σ0.000
min2769.000-2814.000=-45.000
max2769.000-2814.000=-45.000
mean2.989-2.519=0.470
σ0.041-0.077=-0.036
min2.948-2.446=0.502
max3.052-2.613=0.439
iters=5
new-facts=6402
prior-facts=1
mean4751.804-4751.397=0.407
σ0.836-0.845=-0.009
min4751.221-4750.919=0.301
max4753.276-4752.898=0.378
mean2769.000-2814.000=-45.000
σ0.000
min2769.000-2814.000=-45.000
max2769.000-2814.000=-45.000
mean8.203-8.436=-0.233
σ0.629-0.450=0.179
min7.732-7.862=-0.130
max9.172-8.918=0.254
iters=5
new-facts=6402
prior-facts=6402
mean4942.162-4941.870=0.292
σ0.147-0.019=0.128
min4941.903-4941.851=0.052
max4942.258-4941.894=0.363
mean3037.400-3029.000=8.400
σ326.486-215.841=110.644
min2769.000-2814.000=-45.000
max3527.000-3319.000=208.000
mean8.459-8.552=-0.094
σ0.134-0.169=-0.035
min8.355-8.361=-0.005
max8.693-8.805=-0.112

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.107-1.020=0.087
σ0.255-0.138=0.118
min0.928-0.931=-0.003
max1.547-1.247=0.299

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.205-466.756=0.449
σ575.929-575.926=0.003
min179.234-178.786=0.448
max1331.098-1330.645=0.453
mean86.250
σ8.500
min82.000
max99.000
mean2769.000-2814.000=-45.000
σ0.000
min2769.000-2814.000=-45.000
max2769.000-2814.000=-45.000
mean0.477-0.438=0.039
σ0.386-0.302=0.084
min0.283-0.283=-0.001
max1.056-0.891=0.165
policies=20
mean1792.615-1788.138=4.477
σ0.359-0.360=-0.000
min1792.394-1787.892=4.503
max1793.151-1788.668=4.483
mean820.000
σ0.000
min820.000
max820.000
mean2769.000-2814.000=-45.000
σ0.000
min2769.000-2814.000=-45.000
max2769.000-2814.000=-45.000
mean2.781-2.881=-0.100
σ0.014-0.108=-0.094
min2.764-2.766=-0.002
max2.797-3.026=-0.230
policies=200
mean17933.061-17888.131=44.930
σ0.461-0.443=0.018
min17932.804-17887.875=44.929
max17933.752-17888.792=44.960
mean8200.000
σ0.000
min8200.000
max8200.000
mean2769.000-2814.000=-45.000
σ0.000
min2769.000-2814.000=-45.000
max2769.000-2814.000=-45.000
mean27.952-28.028=-0.076
σ0.130-0.096=0.034
min27.797-27.958=-0.161
max28.090-28.169=-0.079