Compare commits

Home / Compare db7eb997 .. a7cda0fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.701=0.001
σ0.047-0.048=-0.001
min70.669-70.662=0.007
max70.834-70.833=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.161-0.159=0.002
σ0.003-0.004=-0.002
min0.159-0.151=0.007
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.000
σ0.003-0.003=-0.000
min21.404-21.404=-0.001
max21.411-21.413=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.066-0.065=0.001
σ0.003-0.002=0.000
min0.063-0.063=0.000
max0.072-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.932=-0.001
σ0.360-0.362=-0.002
min1754.356-1754.365=-0.009
max1755.514-1755.524=-0.010
mean1648.350-1658.850=-10.500
σ623.207-620.318=2.889
min626.000-623.000=3.000
max2772.000-2508.000=264.000
mean2.834-2.781=0.054
σ0.097-0.199=-0.102
min2.611-2.266=0.345
max3.016-3.007=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.759=-0.000
σ0.008-0.006=0.002
min272.749-272.752=-0.004
max272.770-272.768=0.002
mean2772.000-2508.000=264.000
σ0.000
min2772.000-2508.000=264.000
max2772.000-2508.000=264.000
mean0.383-0.387=-0.003
σ0.008-0.009=-0.002
min0.378-0.380=-0.002
max0.395-0.401=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.162-1933.170=-0.009
σ0.008-0.025=-0.017
min1933.150-1933.135=0.016
max1933.171-1933.194=-0.023
mean2772.000-2508.000=264.000
σ0.000
min2772.000-2508.000=264.000
max2772.000-2508.000=264.000
mean3.081-2.995=0.086
σ0.071-0.301=-0.230
min3.016-2.498=0.518
max3.163-3.311=-0.149
iters=5
new-facts=6402
prior-facts=1
mean4756.975-4756.991=-0.016
σ7.568-7.556=0.012
min4753.449-4753.508=-0.059
max4770.512-4770.508=0.005
mean2772.000-2508.000=264.000
σ0.000
min2772.000-2508.000=264.000
max2772.000-2508.000=264.000
mean8.360-8.111=0.250
σ0.509-0.425=0.084
min7.679-7.695=-0.016
max8.949-8.653=0.296
iters=5
new-facts=6402
prior-facts=6402
mean4944.323-4944.394=-0.071
σ0.147-0.021=0.126
min4944.062-4944.369=-0.307
max4944.405-4944.412=-0.007
mean3039.000-2964.600=74.400
σ233.062-432.543=-199.481
min2772.000-2508.000=264.000
max3325.000-3553.000=-228.000
mean8.663-8.409=0.254
σ0.231-0.078=0.153
min8.370-8.325=0.045
max9.012-8.513=0.499

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.669=-0.668
σ0.138-0.270=-0.132
min0.910-1.207=-0.296
max1.227-1.878=-0.651

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.344-468.319=0.025
σ574.255-574.255=0.000
min181.208-181.187=0.021
max1329.727-1329.702=0.025
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2508.000=264.000
σ0.000
min2772.000-2508.000=264.000
max2772.000-2508.000=264.000
mean0.469-0.566=-0.097
σ0.355-0.565=-0.209
min0.290-0.279=0.010
max1.002-1.413=-0.411
policies=20
mean1812.372-1812.175=0.198
σ0.391-0.389=0.002
min1812.095-1811.932=0.163
max1812.946-1812.753=0.193
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2508.000=264.000
σ0.000
min2772.000-2508.000=264.000
max2772.000-2508.000=264.000
mean2.880-2.807=0.072
σ0.006-0.011=-0.005
min2.872-2.794=0.078
max2.886-2.820=0.067
policies=200
mean18129.113-18128.880=0.233
σ0.442-0.523=-0.080
min18128.729-18128.446=0.283
max18129.741-18129.625=0.115
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2508.000=264.000
σ0.000
min2772.000-2508.000=264.000
max2772.000-2508.000=264.000
mean28.353-28.330=0.023
σ0.157-0.164=-0.007
min28.265-28.218=0.047
max28.589-28.568=0.021