Compare commits

Home / Compare 0c6e42cc .. 30cd641a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.048-0.050=-0.002
min33.953-33.947=0.007
max34.112-34.119=-0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.084-0.084=0.000
σ0.003-0.003=-0.000
min0.082-0.082=0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=0.000
min23.314-23.314=-0.000
max23.323-23.324=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.066-0.065=0.001
σ0.003-0.003=0.001
min0.064-0.063=0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.494=-0.001
σ0.364-0.365=-0.001
min1756.919-1756.921=-0.001
max1758.080-1758.080=-0.000
mean1666.300-1647.200=19.100
σ623.379-634.933=-11.554
min689.000-654.000=35.000
max2760.000-2832.000=-72.000
mean2.375-2.377=-0.003
σ0.122-0.110=0.012
min2.168-2.281=-0.114
max2.768-2.671=0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.632-326.635=-0.003
σ0.061-0.054=0.007
min326.523-326.539=-0.016
max326.671-326.668=0.002
mean2760.000-2832.000=-72.000
σ0.000
min2760.000-2832.000=-72.000
max2760.000-2832.000=-72.000
mean0.429-0.423=0.006
σ0.006-0.001=0.005
min0.424-0.422=0.002
max0.439-0.424=0.015
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1988.804=-0.005
σ0.015-0.008=0.007
min1988.782-1988.792=-0.010
max1988.820-1988.814=0.006
mean2760.000-2832.000=-72.000
σ0.000
min2760.000-2832.000=-72.000
max2760.000-2832.000=-72.000
mean2.679-2.703=-0.025
σ0.143-0.105=0.038
min2.576-2.578=-0.003
max2.926-2.831=0.095
iters=5
new-facts=6402
prior-facts=1
mean4813.553-4813.663=-0.110
σ7.513-7.776=-0.263
min4810.142-4810.133=0.009
max4826.992-4827.572=-0.580
mean2760.000-2832.000=-72.000
σ0.000
min2760.000-2832.000=-72.000
max2760.000-2832.000=-72.000
mean8.923-8.991=-0.068
σ0.444-0.405=0.039
min8.467-8.602=-0.135
max9.539-9.591=-0.052
iters=5
new-facts=6402
prior-facts=6402
mean5001.131-5001.211=-0.080
σ0.156-0.039=0.117
min5000.855-5001.177=-0.322
max5001.231-5001.274=-0.043
mean2989.200-3054.000=-64.800
σ228.327-216.849=11.478
min2760.000-2832.000=-72.000
max3322.000-3328.000=-6.000
mean9.645-9.915=-0.269
σ0.182-0.203=-0.021
min9.460-9.641=-0.181
max9.901-10.195=-0.295

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-0.923=0.080
σ0.141-0.008=0.133
min0.912-0.915=-0.003
max1.234-0.935=0.299

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.636-464.629=0.007
σ574.772-574.767=0.005
min177.240-177.244=-0.003
max1326.795-1326.780=0.014
mean88.250
σ8.500
min84.000
max101.000
mean2760.000-2832.000=-72.000
σ0.000
min2760.000-2832.000=-72.000
max2760.000-2832.000=-72.000
mean0.433-0.437=-0.003
σ0.310-0.307=0.003
min0.278-0.279=-0.001
max0.898-0.897=0.001
policies=20
mean1772.712-1772.723=-0.011
σ0.407-0.360=0.048
min1772.443-1772.496=-0.053
max1773.317-1773.259=0.058
mean840.000
σ0.000
min840.000
max840.000
mean2760.000-2832.000=-72.000
σ0.000
min2760.000-2832.000=-72.000
max2760.000-2832.000=-72.000
mean2.839-2.794=0.045
σ0.076-0.008=0.068
min2.799-2.788=0.011
max2.953-2.807=0.147
policies=200
mean17733.884-17734.030=-0.146
σ0.432-0.398=0.033
min17733.480-17733.667=-0.186
max17734.496-17734.598=-0.102
mean8400.000
σ0.000
min8400.000
max8400.000
mean2760.000-2832.000=-72.000
σ0.000
min2760.000-2832.000=-72.000
max2760.000-2832.000=-72.000
mean27.476-27.776=-0.299
σ0.129-0.392=-0.263
min27.321-27.387=-0.066
max27.616-28.181=-0.565