Compare commits

Home / Compare 01507b20 .. b394f061

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.047-73.045=0.002
σ0.048-0.046=0.002
min73.021-73.025=-0.004
max73.181-73.174=0.007
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.161-0.161=0.000
σ0.003-0.003=-0.000
min0.158-0.158=0.000
max0.166-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean23.740-23.741=-0.000
σ0.003-0.003=-0.000
min23.736-23.737=-0.001
max23.745-23.747=-0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.066-0.066=-0.000
σ0.003-0.002=0.000
min0.064-0.064=0.000
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.785=0.003
σ0.360-0.359=0.001
min1758.212-1758.210=0.002
max1759.371-1759.364=0.007
mean1643.150-1661.650=-18.500
σ629.079-626.691=2.388
min620.000-625.000=-5.000
max2783.000-2520.000=263.000
mean2.791-2.753=0.038
σ0.199-0.203=-0.005
min2.200-2.162=0.038
max3.051-2.979=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.013-324.016=-0.002
σ0.053-0.056=-0.002
min323.919-323.917=0.002
max324.045-324.052=-0.007
mean2783.000-2520.000=263.000
σ0.000
min2783.000-2520.000=263.000
max2783.000-2520.000=263.000
mean0.429-0.430=-0.001
σ0.001-0.006=-0.005
min0.426-0.425=0.001
max0.430-0.439=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1984.598-1984.582=0.016
σ0.014-0.015=-0.001
min1984.574-1984.562=0.013
max1984.611-1984.597=0.014
mean2783.000-2520.000=263.000
σ0.000
min2783.000-2520.000=263.000
max2783.000-2520.000=263.000
mean2.662-2.617=0.045
σ0.122-0.117=0.005
min2.547-2.497=0.050
max2.857-2.773=0.084
iters=5
new-facts=6402
prior-facts=1
mean4808.224-4808.172=0.052
σ7.780-7.882=-0.102
min4804.715-4804.075=0.640
max4822.141-4822.258=-0.116
mean2783.000-2520.000=263.000
σ0.000
min2783.000-2520.000=263.000
max2783.000-2520.000=263.000
mean8.809-8.837=-0.028
σ0.210-0.651=-0.440
min8.505-7.713=0.792
max9.001-9.281=-0.280
iters=5
new-facts=6402
prior-facts=6402
mean4995.737-4995.804=-0.067
σ0.147-0.022=0.125
min4995.475-4995.780=-0.305
max4995.817-4995.833=-0.017
mean3020.400-2972.200=48.200
σ289.369-275.213=14.156
min2783.000-2605.000=178.000
max3444.000-3340.000=104.000
mean8.641-8.726=-0.085
σ0.166-0.355=-0.189
min8.466-8.441=0.025
max8.834-9.342=-0.508

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.062-1.557=-0.494
σ0.107-0.243=-0.135
min0.929-1.226=-0.297
max1.230-1.875=-0.645

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.354-468.329=0.024
σ574.245-574.234=0.012
min181.227-181.208=0.019
max1329.721-1329.679=0.042
mean88.250
σ8.500
min84.000
max101.000
mean2783.000-2520.000=263.000
σ0.000
min2783.000-2520.000=263.000
max2783.000-2520.000=263.000
mean0.447-0.576=-0.129
σ0.302-0.589=-0.287
min0.294-0.281=0.013
max0.900-1.460=-0.560
policies=20
mean1812.641-1812.394=0.247
σ0.397-0.387=0.010
min1812.363-1812.144=0.219
max1813.224-1812.969=0.255
mean840.000
σ0.000
min840.000
max840.000
mean2783.000-2520.000=263.000
σ0.000
min2783.000-2520.000=263.000
max2783.000-2520.000=263.000
mean2.890-2.806=0.084
σ0.008-0.013=-0.005
min2.884-2.794=0.089
max2.902-2.820=0.081
policies=200
mean18131.618-18131.554=0.064
σ0.545-0.508=0.037
min18131.149-18131.116=0.033
max18132.353-18132.282=0.071
mean8400.000
σ0.000
min8400.000
max8400.000
mean2783.000-2520.000=263.000
σ0.000
min2783.000-2520.000=263.000
max2783.000-2520.000=263.000
mean28.499-28.248=0.251
σ0.211-0.057=0.154
min28.302-28.183=0.119
max28.737-28.321=0.416