Compare commits

Home / Compare 8f67bbb9 .. d12e421f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.566=-0.000
σ0.045-0.045=-0.001
min70.540-70.537=0.003
max70.689-70.690=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.161-0.159=0.002
σ0.004-0.003=0.000
min0.157-0.154=0.003
max0.167-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.286=0.001
σ0.003-0.002=0.000
min21.283-21.283=0.000
max21.291-21.291=0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.060=0.005
σ0.003-0.003=0.000
min0.063-0.058=0.005
max0.073-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.377=0.191
σ0.360-0.361=-0.001
min1752.991-1752.803=0.188
max1754.150-1753.956=0.194
mean1646.900-1663.300=-16.400
σ639.231-633.864=5.367
min628.000-616.000=12.000
max2876.000-2766.000=110.000
mean2.810-2.801=0.009
σ0.156-0.168=-0.012
min2.418-2.265=0.153
max3.030-3.064=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-271.753=0.264
σ0.008-0.005=0.004
min272.009-271.747=0.261
max272.030-271.760=0.270
mean2876.000-2766.000=110.000
σ0.000
min2876.000-2766.000=110.000
max2876.000-2766.000=110.000
mean0.391-0.378=0.013
σ0.009-0.002=0.007
min0.379-0.375=0.004
max0.402-0.381=0.021
iters=5
new-facts=1
prior-facts=6402
mean1932.439-1932.179=0.261
σ0.011-0.011=-0.000
min1932.421-1932.165=0.256
max1932.450-1932.196=0.254
mean2876.000-2766.000=110.000
σ0.000
min2876.000-2766.000=110.000
max2876.000-2766.000=110.000
mean2.944-2.982=-0.038
σ0.140-0.186=-0.046
min2.796-2.764=0.032
max3.121-3.266=-0.145
iters=5
new-facts=6402
prior-facts=1
mean4753.192-4752.913=0.279
σ0.804-0.849=-0.045
min4752.749-4752.414=0.335
max4754.626-4754.421=0.205
mean2876.000-2766.000=110.000
σ0.000
min2876.000-2766.000=110.000
max2876.000-2766.000=110.000
mean8.375-8.441=-0.066
σ0.412-0.518=-0.107
min7.716-7.610=0.105
max8.728-8.947=-0.219
iters=5
new-facts=6402
prior-facts=6402
mean4943.565-4943.381=0.184
σ0.167-0.015=0.153
min4943.267-4943.361=-0.094
max4943.659-4943.396=0.262
mean3055.000-3046.600=8.400
σ188.258-242.591=-54.333
min2876.000-2766.000=110.000
max3327.000-3395.000=-68.000
mean8.791-8.807=-0.016
σ0.382-0.254=0.128
min8.452-8.468=-0.016
max9.367-9.181=0.186

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-0.995=0.036
σ0.140-0.136=0.004
min0.940-0.931=0.008
max1.260-1.239=0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.076-467.857=5.219
σ575.916-575.928=-0.012
min185.109-179.888=5.221
max1336.950-1331.749=5.201
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2876.000-2766.000=110.000
σ0.000
min2876.000-2766.000=110.000
max2876.000-2766.000=110.000
mean0.487-0.440=0.047
σ0.381-0.307=0.074
min0.277-0.281=-0.003
max1.058-0.901=0.157
policies=20
mean1851.428-1799.131=52.297
σ0.374-0.253=0.122
min1851.141-1798.936=52.206
max1851.970-1799.501=52.469
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2876.000-2766.000=110.000
σ0.000
min2876.000-2766.000=110.000
max2876.000-2766.000=110.000
mean2.972-2.864=0.107
σ0.021-0.082=-0.061
min2.948-2.796=0.152
max2.994-2.979=0.015
policies=200
mean18520.893-17998.244=522.649
σ0.465-0.918=-0.453
min18520.631-17997.061=523.570
max18521.587-17999.301=522.286
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2876.000-2766.000=110.000
σ0.000
min2876.000-2766.000=110.000
max2876.000-2766.000=110.000
mean29.236-28.264=0.972
σ0.397-0.107=0.290
min28.777-28.175=0.602
max29.745-28.417=1.328