Compare commits

Home / Compare ea4e13d4 .. d5b8ede3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-70.709=2.339
σ0.048-0.047=0.001
min73.020-70.678=2.342
max73.184-70.839=2.345
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.169-0.160=0.010
σ0.011-0.005=0.007
min0.158-0.151=0.007
max0.189-0.167=0.022
cache=y
dps=1
iters=10
policies=100
mean23.740-21.411=2.329
σ0.003-0.002=0.001
min23.737-21.408=2.330
max23.745-21.414=2.331
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.064=0.001
σ0.001-0.003=-0.002
min0.064-0.058=0.006
max0.066-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1754.932=3.856
σ0.359-0.360=-0.000
min1758.223-1754.364=3.859
max1759.354-1755.519=3.835
mean1647.150-1659.150=-12.000
σ617.290-624.427=-7.137
min629.000-641.000=-12.000
max2492.000-2512.000=-20.000
mean2.819-2.779=0.040
σ0.152-0.228=-0.076
min2.366-2.271=0.095
max3.058-3.368=-0.310

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.014-272.792=51.222
σ0.054-0.003=0.051
min323.917-272.788=51.130
max324.041-272.795=51.246
mean2492.000-2512.000=-20.000
σ0.000
min2492.000-2512.000=-20.000
max2492.000-2512.000=-20.000
mean0.427-0.378=0.049
σ0.002-0.001=0.001
min0.424-0.377=0.047
max0.429-0.379=0.050
iters=5
new-facts=1
prior-facts=6402
mean1984.598-1933.223=51.374
σ0.015-0.019=-0.004
min1984.572-1933.197=51.375
max1984.609-1933.241=51.368
mean2492.000-2512.000=-20.000
σ0.000
min2492.000-2512.000=-20.000
max2492.000-2512.000=-20.000
mean2.628-3.059=-0.431
σ0.097-0.134=-0.037
min2.558-2.966=-0.408
max2.794-3.296=-0.502
iters=5
new-facts=6402
prior-facts=1
mean4808.311-4756.825=51.486
σ7.747-7.329=0.418
min4804.640-4753.455=51.185
max4822.164-4769.935=52.229
mean2492.000-2512.000=-20.000
σ0.000
min2492.000-2512.000=-20.000
max2492.000-2512.000=-20.000
mean8.709-8.551=0.159
σ0.587-0.461=0.126
min7.785-7.811=-0.026
max9.313-8.994=0.320
iters=5
new-facts=6402
prior-facts=6402
mean4995.807-4944.442=51.366
σ0.021-0.026=-0.005
min4995.782-4944.415=51.367
max4995.826-4944.470=51.356
mean2930.600-2938.200=-7.600
σ369.481-300.747=68.734
min2492.000-2512.000=-20.000
max3433.000-3308.000=125.000
mean8.655-8.426=0.229
σ0.183-0.070=0.113
min8.498-8.350=0.147
max8.938-8.516=0.422

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.709-1.551=0.158
σ0.163-0.115=0.048
min1.418-1.360=0.058
max1.792-1.664=0.128

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.328-468.307=0.021
σ574.231-574.231=0.000
min181.207-181.185=0.022
max1329.674-1329.653=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2492.000-2512.000=-20.000
σ0.000
min2492.000-2512.000=-20.000
max2492.000-2512.000=-20.000
mean0.562-0.550=0.013
σ0.560-0.532=0.028
min0.280-0.283=-0.003
max1.402-1.348=0.054
policies=20
mean1812.421-1812.176=0.246
σ0.413-0.374=0.039
min1812.161-1811.925=0.237
max1813.035-1812.730=0.305
mean840.000
σ0.000
min840.000
max840.000
mean2492.000-2512.000=-20.000
σ0.000
min2492.000-2512.000=-20.000
max2492.000-2512.000=-20.000
mean2.836-2.803=0.033
σ0.065-0.004=0.060
min2.788-2.799=-0.011
max2.930-2.807=0.124
policies=200
mean18131.465-18128.994=2.472
σ0.418-0.611=-0.192
min18131.165-18128.586=2.579
max18132.081-18129.885=2.195
mean8400.000
σ0.000
min8400.000
max8400.000
mean2492.000-2512.000=-20.000
σ0.000
min2492.000-2512.000=-20.000
max2492.000-2512.000=-20.000
mean28.228-28.285=-0.057
σ0.055-0.071=-0.016
min28.167-28.192=-0.026
max28.278-28.343=-0.065