Compare commits

Home / Compare aaa35101 .. b58c20a9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean56.290-56.289=0.001
σ0.053-0.051=0.003
min56.253-56.256=-0.003
max56.436-56.428=0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.141-0.138=0.003
σ0.004-0.005=-0.001
min0.137-0.131=0.007
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean44.805-44.805=-0.000
σ0.005-0.006=-0.001
min44.797-44.795=0.003
max44.815-44.813=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.122-0.122=0.001
σ0.005-0.005=-0.000
min0.118-0.118=0.000
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1766.169-1766.168=0.001
σ0.367-0.366=0.000
min1765.590-1765.591=-0.001
max1766.759-1766.760=-0.001
mean1650.550-1615.450=35.100
σ622.851-590.612=32.239
min633.000-636.000=-3.000
max2506.000-2405.000=101.000
mean2.324-2.341=-0.017
σ0.080-0.073=0.007
min2.155-2.214=-0.059
max2.461-2.477=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean348.778-348.776=0.002
σ0.062-0.062=0.000
min348.667-348.665=0.002
max348.810-348.812=-0.001
mean2506.000-2405.000=101.000
σ0.000
min2506.000-2405.000=101.000
max2506.000-2405.000=101.000
mean0.457-0.460=-0.002
σ0.009-0.008=0.001
min0.452-0.453=-0.001
max0.474-0.471=0.003
iters=5
new-facts=1
prior-facts=6402
mean2009.248-2009.246=0.002
σ0.004-0.005=-0.001
min2009.244-2009.240=0.004
max2009.253-2009.252=0.002
mean2506.000-2405.000=101.000
σ0.000
min2506.000-2405.000=101.000
max2506.000-2405.000=101.000
mean2.935-2.795=0.139
σ0.095-0.130=-0.035
min2.819-2.683=0.136
max3.063-3.016=0.047
iters=5
new-facts=6402
prior-facts=1
mean4833.011-4833.017=-0.006
σ7.725-7.767=-0.041
min4829.435-4829.432=0.002
max4846.830-4846.909=-0.079
mean2506.000-2405.000=101.000
σ0.000
min2506.000-2405.000=101.000
max2506.000-2405.000=101.000
mean8.513-8.799=-0.285
σ0.514-0.603=-0.089
min7.815-7.762=0.053
max9.152-9.323=-0.171
iters=5
new-facts=6402
prior-facts=6402
mean5020.352-5020.564=-0.212
σ0.315-0.024=0.291
min5019.874-5020.538=-0.664
max5020.592-5020.594=-0.002
mean3000.600-2950.200=50.400
σ393.170-413.730=-20.561
min2506.000-2422.000=84.000
max3518.000-3494.000=24.000
mean8.872-8.836=0.036
σ0.317-0.303=0.014
min8.614-8.501=0.113
max9.229-9.277=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.599-1.741=-0.142
σ0.211-0.075=0.136
min1.234-1.630=-0.396
max1.774-1.840=-0.066

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.536-467.528=0.007
σ574.248-574.245=0.003
min180.405-180.405=0.000
max1328.908-1328.896=0.012
mean88.250
σ8.500
min84.000
max101.000
mean2506.000-2405.000=101.000
σ0.000
min2506.000-2405.000=101.000
max2506.000-2405.000=101.000
mean0.554-0.539=0.014
σ0.546-0.525=0.021
min0.279-0.272=0.008
max1.373-1.326=0.046
policies=20
mean1804.344-1804.356=-0.012
σ0.396-0.404=-0.008
min1804.112-1804.123=-0.010
max1804.935-1804.958=-0.023
mean840.000
σ0.000
min840.000
max840.000
mean2506.000-2405.000=101.000
σ0.000
min2506.000-2405.000=101.000
max2506.000-2405.000=101.000
mean2.777-2.780=-0.003
σ0.011-0.007=0.004
min2.766-2.773=-0.007
max2.789-2.790=-0.000
policies=200
mean18050.631-18050.610=0.021
σ0.475-0.543=-0.069
min18050.249-18050.237=0.012
max18051.324-18051.408=-0.084
mean8400.000
σ0.000
min8400.000
max8400.000
mean2506.000-2405.000=101.000
σ0.000
min2506.000-2405.000=101.000
max2506.000-2405.000=101.000
mean28.088-28.106=-0.018
σ0.152-0.140=0.012
min27.934-28.015=-0.081
max28.266-28.313=-0.047