Compare commits

Home / Compare bdd3add1 .. 143ba7d7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.001
σ0.055-0.054=0.000
min35.592-35.589=0.002
max35.772-35.772=0.000
mean414.200-413.000=1.200
σ0.422-0.000=0.422
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.086-0.086=-0.000
σ0.003-0.004=-0.001
min0.083-0.082=0.001
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.001
σ0.002-0.003=-0.000
min24.043-24.044=-0.001
max24.050-24.052=-0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.069=-0.004
σ0.004-0.003=0.001
min0.061-0.066=-0.005
max0.072-0.077=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=-0.000
σ0.365-0.366=-0.001
min1755.914-1755.915=-0.001
max1757.081-1757.078=0.004
mean1649.550-1625.250=24.300
σ640.658-593.044=47.614
min633.000-657.000=-24.000
max2828.000-2423.000=405.000
mean2.358-2.316=0.042
σ0.064-0.072=-0.009
min2.287-2.250=0.037
max2.493-2.483=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.768-324.740=0.028
σ0.047-0.048=-0.001
min324.686-324.654=0.031
max324.800-324.765=0.035
mean2828.000-2423.000=405.000
σ0.000
min2828.000-2423.000=405.000
max2828.000-2423.000=405.000
mean0.431-0.433=-0.001
σ0.020-0.008=0.011
min0.421-0.425=-0.004
max0.467-0.445=0.022
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.321=-0.008
σ0.021-0.024=-0.002
min1985.286-1985.281=0.005
max1985.336-1985.339=-0.002
mean2828.000-2423.000=405.000
σ0.000
min2828.000-2423.000=405.000
max2828.000-2423.000=405.000
mean2.660-2.577=0.083
σ0.170-0.080=0.090
min2.453-2.467=-0.014
max2.885-2.677=0.208
iters=5
new-facts=6402
prior-facts=1
mean4809.091-4809.080=0.011
σ7.718-7.729=-0.011
min4805.575-4805.592=-0.017
max4822.897-4822.907=-0.009
mean2828.000-2423.000=405.000
σ0.000
min2828.000-2423.000=405.000
max2828.000-2423.000=405.000
mean8.917-9.020=-0.103
σ0.181-0.251=-0.071
min8.598-8.823=-0.224
max9.032-9.455=-0.424
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4996.629=-0.008
σ0.027-0.021=0.005
min4996.595-4996.602=-0.007
max4996.654-4996.652=0.002
mean3067.000-2998.400=68.600
σ310.052-257.924=52.128
min2828.000-2615.000=213.000
max3541.000-3306.000=235.000
mean8.560-8.627=-0.066
σ0.116-0.152=-0.036
min8.454-8.365=0.089
max8.746-8.754=-0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-1.541=-0.588
σ0.054-0.193=-0.139
min0.922-1.205=-0.283
max1.048-1.668=-0.620

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.203=0.003
σ574.766-574.767=-0.000
min175.819-175.813=0.006
max1325.355-1325.353=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2423.000=405.000
σ0.000
min2828.000-2423.000=405.000
max2828.000-2423.000=405.000
mean0.431-0.543=-0.113
σ0.300-0.540=-0.240
min0.279-0.265=0.014
max0.880-1.353=-0.473
policies=20
mean1758.534-1758.470=0.064
σ0.353-0.346=0.007
min1758.301-1758.229=0.073
max1759.058-1758.982=0.076
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2423.000=405.000
σ0.000
min2828.000-2423.000=405.000
max2828.000-2423.000=405.000
mean2.784-2.716=0.068
σ0.054-0.008=0.046
min2.725-2.707=0.017
max2.849-2.726=0.123
policies=200
mean17592.080-17592.140=-0.060
σ0.579-0.504=0.076
min17591.529-17591.838=-0.310
max17592.897-17592.893=0.003
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2423.000=405.000
σ0.000
min2828.000-2423.000=405.000
max2828.000-2423.000=405.000
mean27.910-27.424=0.486
σ0.661-0.120=0.541
min27.283-27.307=-0.024
max28.742-27.532=1.210