Compare commits

Home / Compare a776414b .. bd370bd7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.244=0.001
σ0.055-0.052=0.003
min35.218-35.217=0.000
max35.398-35.390=0.008
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.085-0.082=0.003
σ0.003-0.007=-0.003
min0.083-0.066=0.017
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.000
σ0.003-0.005=-0.002
min23.765-23.764=0.001
max23.775-23.782=-0.008
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.069-0.067=0.002
σ0.004-0.005=-0.001
min0.066-0.061=0.005
max0.075-0.077=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.485=-0.001
σ0.365-0.365=0.000
min1755.910-1755.909=0.001
max1757.081-1757.069=0.011
mean1648.250-1652.050=-3.800
σ640.509-642.219=-1.710
min625.000-626.000=-1.000
max2830.000-2835.000=-5.000
mean2.358-2.337=0.021
σ0.119-0.064=0.056
min2.264-2.260=0.004
max2.794-2.476=0.317

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.700-324.700=0.000
σ0.063-0.060=0.002
min324.589-324.592=-0.003
max324.738-324.731=0.007
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean0.437-0.432=0.006
σ0.010-0.008=0.002
min0.424-0.425=-0.001
max0.450-0.443=0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.264=-0.002
σ0.011-0.013=-0.001
min1985.244-1985.243=0.000
max1985.273-1985.275=-0.002
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean2.681-2.578=0.102
σ0.137-0.051=0.086
min2.551-2.522=0.029
max2.882-2.659=0.223
iters=5
new-facts=6402
prior-facts=1
mean4808.780-4808.873=-0.093
σ7.754-7.687=0.067
min4805.067-4805.387=-0.320
max4822.648-4822.624=0.025
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean8.568-8.921=-0.353
σ0.662-0.502=0.161
min7.766-8.189=-0.422
max9.099-9.574=-0.475
iters=5
new-facts=6402
prior-facts=6402
mean4996.454-4996.467=-0.013
σ0.024-0.022=0.002
min4996.423-4996.441=-0.017
max4996.477-4996.486=-0.010
mean3060.400-3061.400=-1.000
σ304.147-226.758=77.389
min2830.000-2835.000=-5.000
max3531.000-3400.000=131.000
mean8.572-8.806=-0.234
σ0.151-0.313=-0.162
min8.448-8.517=-0.069
max8.784-9.248=-0.464

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-0.994=0.043
σ0.162-0.065=0.097
min0.915-0.912=0.002
max1.217-1.048=0.169

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.976=-0.001
σ574.253-574.254=-0.000
min175.839-175.838=0.001
max1324.355-1324.356=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean0.474-0.429=0.045
σ0.378-0.289=0.089
min0.281-0.282=-0.001
max1.041-0.863=0.178
policies=20
mean1758.714-1758.699=0.015
σ0.345-0.359=-0.014
min1758.478-1758.448=0.030
max1759.225-1759.230=-0.005
mean820.000
σ0.000
min820.000
max820.000
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean2.801-2.798=0.003
σ0.003-0.009=-0.006
min2.797-2.786=0.011
max2.805-2.808=-0.003
policies=200
mean17593.173-17593.214=-0.042
σ0.618-0.756=-0.138
min17592.283-17592.226=0.057
max17593.596-17593.852=-0.256
mean8200.000
σ0.000
min8200.000
max8200.000
mean2830.000-2835.000=-5.000
σ0.000
min2830.000-2835.000=-5.000
max2830.000-2835.000=-5.000
mean27.980-27.980=-0.000
σ0.362-0.318=0.043
min27.612-27.716=-0.103
max28.365-28.364=0.000