Compare commits

Home / Compare a9d805e7 .. 220a3e28

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.262=0.357
σ0.054-0.054=0.000
min35.589-35.237=0.352
max35.772-35.415=0.356
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.086-0.081=0.005
σ0.004-0.005=-0.000
min0.082-0.076=0.006
max0.094-0.089=0.005
cache=y
dps=1
iters=10
policies=100
mean24.047-23.770=0.278
σ0.003-0.002=0.001
min24.044-23.765=0.279
max24.052-23.774=0.278
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.069-0.069=0.000
σ0.003-0.003=0.000
min0.066-0.067=-0.001
max0.077-0.075=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.486=0.004
σ0.366-0.365=0.001
min1755.915-1755.912=0.003
max1757.078-1757.077=0.000
mean1625.250-1651.000=-25.750
σ593.044-640.585=-47.541
min657.000-628.000=29.000
max2423.000-2840.000=-417.000
mean2.316-2.329=-0.013
σ0.072-0.059=0.013
min2.250-2.256=-0.005
max2.483-2.433=0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.740-324.706=0.034
σ0.048-0.048=0.000
min324.654-324.621=0.033
max324.765-324.740=0.025
mean2423.000-2840.000=-417.000
σ0.000
min2423.000-2840.000=-417.000
max2423.000-2840.000=-417.000
mean0.433-0.426=0.007
σ0.008-0.006=0.003
min0.425-0.422=0.003
max0.445-0.436=0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.321-1985.270=0.051
σ0.024-0.007=0.016
min1985.281-1985.259=0.021
max1985.339-1985.277=0.061
mean2423.000-2840.000=-417.000
σ0.000
min2423.000-2840.000=-417.000
max2423.000-2840.000=-417.000
mean2.577-2.596=-0.019
σ0.080-0.058=0.023
min2.467-2.543=-0.076
max2.677-2.669=0.008
iters=5
new-facts=6402
prior-facts=1
mean4809.080-4808.911=0.169
σ7.729-7.708=0.021
min4805.592-4805.357=0.236
max4822.907-4822.698=0.208
mean2423.000-2840.000=-417.000
σ0.000
min2423.000-2840.000=-417.000
max2423.000-2840.000=-417.000
mean9.020-8.833=0.187
σ0.251-0.627=-0.375
min8.823-7.771=1.051
max9.455-9.353=0.103
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.463=0.167
σ0.021-0.021=0.000
min4996.602-4996.440=0.162
max4996.652-4996.482=0.170
mean2998.400-3054.600=-56.200
σ257.924-201.676=56.248
min2615.000-2840.000=-225.000
max3306.000-3350.000=-44.000
mean8.627-8.706=-0.080
σ0.152-0.237=-0.085
min8.365-8.475=-0.110
max8.754-9.071=-0.317

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.541-1.007=0.534
σ0.193-0.136=0.057
min1.205-0.916=0.289
max1.668-1.228=0.440

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-462.969=0.234
σ574.767-574.253=0.514
min175.813-175.836=-0.023
max1325.353-1324.348=1.005
mean86.250
σ8.500
min82.000
max99.000
mean2423.000-2840.000=-417.000
σ0.000
min2423.000-2840.000=-417.000
max2423.000-2840.000=-417.000
mean0.543-0.472=0.071
σ0.540-0.382=0.158
min0.265-0.279=-0.014
max1.353-1.045=0.308
policies=20
mean1758.470-1758.707=-0.237
σ0.346-0.343=0.003
min1758.229-1758.480=-0.251
max1758.982-1759.216=-0.234
mean820.000
σ0.000
min820.000
max820.000
mean2423.000-2840.000=-417.000
σ0.000
min2423.000-2840.000=-417.000
max2423.000-2840.000=-417.000
mean2.716-2.790=-0.073
σ0.008-0.015=-0.007
min2.707-2.779=-0.072
max2.726-2.812=-0.086
policies=200
mean17592.140-17593.384=-1.244
σ0.504-0.705=-0.202
min17591.838-17592.409=-0.571
max17592.893-17593.926=-1.032
mean8200.000
σ0.000
min8200.000
max8200.000
mean2423.000-2840.000=-417.000
σ0.000
min2423.000-2840.000=-417.000
max2423.000-2840.000=-417.000
mean27.424-27.903=-0.479
σ0.120-0.365=-0.245
min27.307-27.543=-0.236
max27.532-28.348=-0.816