Compare commits

Home / Compare 4d2bc04d .. 7c55312c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.246-35.244=0.002
σ0.053-0.055=-0.002
min35.221-35.218=0.003
max35.394-35.398=-0.004
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.086-0.081=0.005
σ0.004-0.005=-0.001
min0.083-0.075=0.007
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.771-23.769=0.002
σ0.002-0.002=-0.000
min23.768-23.766=0.002
max23.774-23.772=0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.069-0.068=0.001
σ0.003-0.003=-0.000
min0.066-0.065=0.001
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.363=-0.001
σ0.364-0.367=-0.003
min1755.789-1755.790=-0.001
max1756.949-1756.951=-0.002
mean1649.350-1643.150=6.200
σ644.224-632.772=11.452
min624.000-623.000=1.000
max2833.000-2750.000=83.000
mean2.344-2.317=0.026
σ0.080-0.082=-0.002
min2.261-2.179=0.082
max2.555-2.572=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.589-324.589=-0.001
σ0.048-0.042=0.006
min324.504-324.514=-0.010
max324.623-324.613=0.010
mean2833.000-2750.000=83.000
σ0.000
min2833.000-2750.000=83.000
max2833.000-2750.000=83.000
mean0.422-0.422=0.000
σ0.003-0.001=0.001
min0.419-0.421=-0.001
max0.426-0.423=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.149-1985.145=0.004
σ0.012-0.018=-0.006
min1985.136-1985.114=0.023
max1985.167-1985.157=0.010
mean2833.000-2750.000=83.000
σ0.000
min2833.000-2750.000=83.000
max2833.000-2750.000=83.000
mean2.556-2.620=-0.063
σ0.112-0.081=0.031
min2.428-2.558=-0.130
max2.737-2.720=0.018
iters=5
new-facts=6402
prior-facts=1
mean4808.519-4808.748=-0.230
σ7.867-7.657=0.210
min4804.150-4805.244=-1.093
max4822.563-4822.446=0.118
mean2833.000-2750.000=83.000
σ0.000
min2833.000-2750.000=83.000
max2833.000-2750.000=83.000
mean8.934-8.892=0.042
σ0.304-0.309=-0.005
min8.489-8.535=-0.046
max9.288-9.289=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean4996.343-4996.348=-0.005
σ0.022-0.030=-0.008
min4996.315-4996.321=-0.006
max4996.372-4996.394=-0.023
mean3059.200-3031.200=28.000
σ238.840-342.191=-103.351
min2833.000-2750.000=83.000
max3406.000-3539.000=-133.000
mean8.651-8.832=-0.180
σ0.241-0.709=-0.468
min8.463-8.439=0.023
max9.065-10.080=-1.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.939-1.111=-0.173
σ0.055-0.209=-0.154
min0.906-0.948=-0.042
max1.034-1.477=-0.443

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.965-462.973=-0.007
σ574.246-574.245=0.000
min175.838-175.839=-0.001
max1324.334-1324.341=-0.007
mean86.250
σ8.500
min82.000
max99.000
mean2833.000-2750.000=83.000
σ0.000
min2833.000-2750.000=83.000
max2833.000-2750.000=83.000
mean0.428-0.431=-0.002
σ0.293-0.294=-0.001
min0.280-0.280=-0.000
max0.868-0.872=-0.004
policies=20
mean1758.694-1758.696=-0.002
σ0.342-0.318=0.024
min1758.483-1758.483=0.000
max1759.203-1759.168=0.035
mean820.000
σ0.000
min820.000
max820.000
mean2833.000-2750.000=83.000
σ0.000
min2833.000-2750.000=83.000
max2833.000-2750.000=83.000
mean2.777-2.824=-0.047
σ0.004-0.065=-0.062
min2.772-2.774=-0.001
max2.781-2.920=-0.139
policies=200
mean17593.320-17592.422=0.898
σ0.548-0.536=0.012
min17592.592-17592.063=0.530
max17593.842-17593.220=0.622
mean8200.000
σ0.000
min8200.000
max8200.000
mean2833.000-2750.000=83.000
σ0.000
min2833.000-2750.000=83.000
max2833.000-2750.000=83.000
mean27.867-27.239=0.628
σ0.342-0.146=0.196
min27.433-27.115=0.319
max28.245-27.446=0.799