Compare commits

Home / Compare e3b7a707 .. fd2a3d20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.389=0.002
σ0.045-0.048=-0.003
min70.365-70.361=0.005
max70.515-70.522=-0.007
mean414.000
σ0.000
min414.000
max414.000
mean0.161-0.157=0.005
σ0.004-0.005=-0.001
min0.156-0.151=0.005
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.003=-0.001
min21.142-21.138=0.003
max21.149-21.147=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.000
min0.063-0.063=0.000
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.394=0.305
σ0.362-0.366=-0.004
min1752.125-1751.827=0.297
max1753.282-1752.976=0.305
mean1680.250-1654.350=25.900
σ631.871-645.227=-13.356
min667.000-631.000=36.000
max2691.000-2849.000=-158.000
mean2.838-2.763=0.075
σ0.067-0.176=-0.109
min2.722-2.428=0.294
max2.975-3.032=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.514-270.133=0.381
σ0.005-0.015=-0.010
min270.507-270.119=0.387
max270.520-270.154=0.366
mean2691.000-2849.000=-158.000
σ0.000
min2691.000-2849.000=-158.000
max2691.000-2849.000=-158.000
mean0.383-0.386=-0.003
σ0.008-0.008=-0.000
min0.378-0.377=0.001
max0.397-0.398=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.940-1930.609=0.331
σ0.005-0.005=0.000
min1930.933-1930.602=0.331
max1930.946-1930.613=0.332
mean2691.000-2849.000=-158.000
σ0.000
min2691.000-2849.000=-158.000
max2691.000-2849.000=-158.000
mean3.047-2.543=0.504
σ0.084-0.162=-0.078
min2.968-2.383=0.584
max3.176-2.806=0.370
iters=5
new-facts=6402
prior-facts=1
mean4751.419-4751.351=0.069
σ0.428-0.829=-0.400
min4751.161-4750.877=0.285
max4752.181-4752.823=-0.642
mean2691.000-2849.000=-158.000
σ0.000
min2691.000-2849.000=-158.000
max2691.000-2849.000=-158.000
mean8.728-8.210=0.518
σ0.253-0.452=-0.199
min8.405-7.705=0.700
max9.027-8.693=0.334
iters=5
new-facts=6402
prior-facts=6402
mean4942.146-4941.772=0.374
σ0.010-0.018=-0.008
min4942.133-4941.753=0.381
max4942.159-4941.794=0.364
mean3005.200-3052.600=-47.400
σ254.354-188.894=65.461
min2691.000-2849.000=-158.000
max3330.000-3323.000=7.000
mean8.630-8.534=0.097
σ0.339-0.151=0.188
min8.353-8.387=-0.034
max9.205-8.734=0.471

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.022=0.042
σ0.138-0.187=-0.049
min0.926-0.935=-0.009
max1.226-1.356=-0.130

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.829-466.377=0.453
σ575.937-575.924=0.013
min178.853-178.409=0.444
max1330.735-1330.263=0.472
mean84.000
σ8.000
min80.000
max96.000
mean2691.000-2849.000=-158.000
σ0.000
min2691.000-2849.000=-158.000
max2691.000-2849.000=-158.000
mean0.559-0.441=0.118
σ0.553-0.303=0.250
min0.282-0.284=-0.003
max1.388-0.895=0.493
policies=20
mean1788.812-1784.368=4.444
σ0.351-0.357=-0.005
min1788.590-1784.127=4.462
max1789.336-1784.895=4.441
mean800.000
σ0.000
min800.000
max800.000
mean2691.000-2849.000=-158.000
σ0.000
min2691.000-2849.000=-158.000
max2691.000-2849.000=-158.000
mean2.774-2.850=-0.075
σ0.009-0.010=-0.001
min2.767-2.841=-0.074
max2.787-2.861=-0.074
policies=200
mean17894.817-17849.829=44.988
σ0.453-0.501=-0.048
min17894.572-17849.461=45.111
max17895.496-17850.550=44.946
mean8000.000
σ0.000
min8000.000
max8000.000
mean2691.000-2849.000=-158.000
σ0.000
min2691.000-2849.000=-158.000
max2691.000-2849.000=-158.000
mean27.938-28.287=-0.349
σ0.110-0.468=-0.358
min27.847-27.782=0.065
max28.092-28.711=-0.619