Compare commits

Home / Compare dfedb22a .. c785d73a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.701=-0.000
σ0.047-0.048=-0.001
min70.670-70.666=0.004
max70.829-70.831=-0.001
mean411.600-416.000=-4.400
σ0.516-0.000=0.516
min411.000-416.000=-5.000
max412.000-416.000=-4.000
mean0.159-0.157=0.002
σ0.005-0.006=-0.000
min0.151-0.150=0.001
max0.170-0.167=0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=0.000
σ0.002-0.002=0.000
min21.405-21.405=-0.000
max21.413-21.413=0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.063-0.065=-0.002
σ0.004-0.004=0.001
min0.059-0.059=-0.000
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.930=-0.002
σ0.361-0.361=0.000
min1754.357-1754.362=-0.005
max1755.515-1755.531=-0.016
mean1663.300-1649.600=13.700
σ617.559-632.332=-14.773
min622.000-624.000=-2.000
max2485.000-2772.000=-287.000
mean2.809-2.832=-0.023
σ0.132-0.162=-0.031
min2.520-2.441=0.078
max2.982-3.191=-0.210

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.754-272.731=0.023
σ0.007-0.007=-0.000
min272.748-272.723=0.025
max272.762-272.738=0.024
mean2485.000-2772.000=-287.000
σ0.000
min2485.000-2772.000=-287.000
max2485.000-2772.000=-287.000
mean0.382-0.383=-0.001
σ0.004-0.009=-0.005
min0.379-0.378=0.001
max0.389-0.399=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.167-1933.157=0.010
σ0.010-0.020=-0.010
min1933.153-1933.122=0.031
max1933.181-1933.170=0.011
mean2485.000-2772.000=-287.000
σ0.000
min2485.000-2772.000=-287.000
max2485.000-2772.000=-287.000
mean3.151-3.030=0.121
σ0.252-0.140=0.112
min2.841-2.831=0.010
max3.426-3.186=0.239
iters=5
new-facts=6402
prior-facts=1
mean4756.887-4756.779=0.108
σ7.283-7.708=-0.425
min4753.555-4752.923=0.632
max4769.915-4770.560=-0.646
mean2485.000-2772.000=-287.000
σ0.000
min2485.000-2772.000=-287.000
max2485.000-2772.000=-287.000
mean8.057-8.809=-0.752
σ0.330-0.147=0.184
min7.704-8.641=-0.937
max8.460-9.002=-0.542
iters=5
new-facts=6402
prior-facts=6402
mean4944.322-4944.257=0.066
σ0.174-0.176=-0.002
min4944.013-4944.062=-0.049
max4944.417-4944.387=0.030
mean2935.000-3023.800=-88.800
σ402.008-251.364=150.644
min2485.000-2772.000=-287.000
max3466.000-3379.000=87.000
mean8.435-8.620=-0.185
σ0.115-0.202=-0.087
min8.338-8.423=-0.085
max8.631-8.957=-0.325

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.626-1.008=0.618
σ0.202-0.133=0.068
min1.356-0.920=0.436
max1.803-1.227=0.576

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.317-468.345=-0.027
σ574.255-574.255=0.000
min181.187-181.207=-0.020
max1329.700-1329.727=-0.027
mean88.250
σ8.500
min84.000
max101.000
mean2485.000-2772.000=-287.000
σ0.000
min2485.000-2772.000=-287.000
max2485.000-2772.000=-287.000
mean0.582-0.447=0.134
σ0.593-0.305=0.288
min0.285-0.292=-0.007
max1.471-0.905=0.566
policies=20
mean1812.178-1812.345=-0.166
σ0.387-0.325=0.063
min1811.924-1812.102=-0.178
max1812.752-1812.815=-0.063
mean840.000
σ0.000
min840.000
max840.000
mean2485.000-2772.000=-287.000
σ0.000
min2485.000-2772.000=-287.000
max2485.000-2772.000=-287.000
mean2.820-2.896=-0.076
σ0.009-0.008=0.001
min2.812-2.887=-0.076
max2.832-2.907=-0.075
policies=200
mean18128.882-18129.098=-0.217
σ0.603-0.470=0.133
min18128.467-18128.765=-0.298
max18129.777-18129.790=-0.012
mean8400.000
σ0.000
min8400.000
max8400.000
mean2485.000-2772.000=-287.000
σ0.000
min2485.000-2772.000=-287.000
max2485.000-2772.000=-287.000
mean28.374-28.399=-0.024
σ0.099-0.204=-0.105
min28.236-28.176=0.060
max28.460-28.657=-0.197