Compare commits

Home / Compare df5b8b2f .. b4266a06

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-54.431=-0.516
σ0.367-0.049=0.318
min53.783-54.387=-0.604
max54.960-54.565=0.396
mean416.800-413.700=3.100
σ0.422-0.483=-0.061
min416.000-413.000=3.000
max417.000-414.000=3.000
mean0.139-0.135=0.004
σ0.004-0.005=-0.001
min0.136-0.129=0.007
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.143-43.760=-0.617
σ0.011-0.004=0.007
min43.131-43.755=-0.624
max43.169-43.766=-0.597
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.119-0.117=0.002
σ0.004-0.004=0.000
min0.113-0.110=0.004
max0.127-0.124=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.084-1764.851=-772.768
σ1.224-0.366=0.857
min991.496-1764.270=-772.774
max997.214-1765.434=-768.220
mean1066.100-1631.800=-565.700
σ314.740-622.168=-307.428
min605.000-624.000=-19.000
max1593.000-2756.000=-1163.000
mean1.520-2.594=-1.074
σ0.081-0.236=-0.155
min1.426-2.301=-0.875
max1.767-3.018=-1.250

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.603-345.195=-59.592
σ0.011-0.070=-0.059
min285.587-345.070=-59.484
max285.614-345.234=-59.620
mean1593.000-2756.000=-1163.000
σ0.000
min1593.000-2756.000=-1163.000
max1593.000-2756.000=-1163.000
mean0.378-0.446=-0.068
σ0.005-0.003=0.002
min0.375-0.441=-0.066
max0.388-0.450=-0.062
iters=5
new-facts=1
prior-facts=6402
mean1285.567-2007.372=-721.805
σ0.134-0.012=0.122
min1285.502-2007.353=-721.850
max1285.807-2007.385=-721.578
mean1593.000-2756.000=-1163.000
σ0.000
min1593.000-2756.000=-1163.000
max1593.000-2756.000=-1163.000
mean1.846-2.755=-0.909
σ0.042-0.131=-0.089
min1.806-2.647=-0.841
max1.914-2.972=-1.058
iters=5
new-facts=6402
prior-facts=1
mean1807.884-4832.145=-3024.260
σ7.023-7.810=-0.787
min1804.540-4828.380=-3023.841
max1820.432-4846.113=-3025.680
mean1593.000-2756.000=-1163.000
σ0.000
min1593.000-2756.000=-1163.000
max1593.000-2756.000=-1163.000
mean4.135-8.655=-4.520
σ0.168-0.649=-0.481
min3.969-7.694=-3.725
max4.379-9.259=-4.880
iters=5
new-facts=6402
prior-facts=6402
mean2070.393-5019.764=-2949.372
σ0.010-0.017=-0.007
min2070.380-5019.743=-2949.363
max2070.408-5019.783=-2949.375
mean1842.800-3010.000=-1167.200
σ202.226-237.120=-34.895
min1605.000-2756.000=-1151.000
max2095.000-3320.000=-1225.000
mean4.539-9.650=-5.112
σ0.135-0.256=-0.121
min4.450-9.216=-4.765
max4.775-9.883=-5.107

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.262-1.027=0.234
σ0.377-0.130=0.247
min0.916-0.900=0.016
max1.810-1.222=0.588

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.387-466.714=-29.327
σ572.363-574.765=-2.402
min151.199-179.319=-28.120
max1295.931-1328.862=-32.930
mean90.250
σ8.500
min86.000
max103.000
mean1593.000-2756.000=-1163.000
σ0.000
min1593.000-2756.000=-1163.000
max1593.000-2756.000=-1163.000
mean0.525-0.475=0.050
σ0.534-0.398=0.136
min0.255-0.276=-0.021
max1.326-1.071=0.254
policies=20
mean1512.210-1793.506=-281.296
σ0.250-0.378=-0.127
min1512.047-1793.269=-281.223
max1512.583-1794.070=-281.487
mean860.000
σ0.000
min860.000
max860.000
mean1593.000-2756.000=-1163.000
σ0.000
min1593.000-2756.000=-1163.000
max1593.000-2756.000=-1163.000
mean2.545-2.763=-0.219
σ0.011-0.010=0.001
min2.530-2.756=-0.226
max2.555-2.778=-0.222
policies=200
mean15129.621-17942.130=-2812.509
σ0.077-0.510=-0.433
min15129.552-17941.854=-2812.302
max15129.698-17942.894=-2813.196
mean8600.000
σ0.000
min8600.000
max8600.000
mean1593.000-2756.000=-1163.000
σ0.000
min1593.000-2756.000=-1163.000
max1593.000-2756.000=-1163.000
mean25.773-27.815=-2.042
σ0.125-0.128=-0.004
min25.660-27.741=-2.081
max25.949-28.006=-2.057