Compare commits

Home / Compare 330ab809 .. 7e1a2424

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.245=0.001
σ0.052-0.053=-0.001
min35.216-35.217=-0.001
max35.391-35.394=-0.004
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.086-0.085=0.001
σ0.004-0.003=0.001
min0.082-0.082=-0.000
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.002=0.001
min23.765-23.767=-0.001
max23.776-23.774=0.002
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.067-0.066=0.001
σ0.001-0.004=-0.004
min0.065-0.061=0.004
max0.068-0.074=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.362=0.001
σ0.365-0.367=-0.002
min1755.788-1755.790=-0.002
max1756.958-1756.951=0.007
mean1643.750-1648.600=-4.850
σ631.702-640.100=-8.398
min627.000-673.000=-46.000
max2839.000-2733.000=106.000
mean2.332-2.342=-0.009
σ0.081-0.105=-0.025
min2.242-2.181=0.062
max2.543-2.563=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.587-324.584=0.002
σ0.034-0.043=-0.010
min324.529-324.507=0.021
max324.616-324.607=0.009
mean2839.000-2733.000=106.000
σ0.000
min2839.000-2733.000=106.000
max2839.000-2733.000=106.000
mean0.422-0.423=-0.001
σ0.001-0.001=0.000
min0.421-0.422=-0.001
max0.424-0.425=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.145-1985.137=0.007
σ0.007-0.016=-0.009
min1985.135-1985.117=0.018
max1985.153-1985.156=-0.004
mean2839.000-2733.000=106.000
σ0.000
min2839.000-2733.000=106.000
max2839.000-2733.000=106.000
mean2.573-2.686=-0.113
σ0.043-0.149=-0.105
min2.538-2.564=-0.026
max2.644-2.932=-0.288
iters=5
new-facts=6402
prior-facts=1
mean4808.735-4808.541=0.194
σ7.625-7.784=-0.159
min4805.250-4804.670=0.581
max4822.374-4822.455=-0.082
mean2839.000-2733.000=106.000
σ0.000
min2839.000-2733.000=106.000
max2839.000-2733.000=106.000
mean8.763-8.494=0.268
σ0.264-0.676=-0.412
min8.319-7.762=0.556
max9.025-9.211=-0.187
iters=5
new-facts=6402
prior-facts=6402
mean4996.347-4996.339=0.008
σ0.021-0.019=0.002
min4996.318-4996.313=0.005
max4996.369-4996.355=0.014
mean3053.400-3026.400=27.000
σ185.550-347.765=-162.215
min2839.000-2733.000=106.000
max3315.000-3542.000=-227.000
mean8.789-8.500=0.289
σ0.276-0.139=0.137
min8.495-8.403=0.092
max9.146-8.744=0.402

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.002=-0.007
σ0.067-0.067=-0.001
min0.905-0.920=-0.015
max1.048-1.055=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.975-462.971=0.004
σ574.252-574.281=-0.029
min175.838-175.820=0.018
max1324.354-1324.393=-0.039
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2733.000=106.000
σ0.000
min2839.000-2733.000=106.000
max2839.000-2733.000=106.000
mean0.431-0.496=-0.065
σ0.304-0.445=-0.141
min0.277-0.273=0.004
max0.887-1.163=-0.276
policies=20
mean1758.717-1758.530=0.187
σ0.350-0.328=0.022
min1758.477-1758.297=0.180
max1759.235-1759.015=0.220
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2733.000=106.000
σ0.000
min2839.000-2733.000=106.000
max2839.000-2733.000=106.000
mean2.786-2.714=0.072
σ0.028-0.011=0.018
min2.748-2.703=0.045
max2.812-2.726=0.086
policies=200
mean17593.266-17592.313=0.953
σ0.743-0.596=0.146
min17592.244-17591.912=0.332
max17593.840-17593.197=0.643
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2733.000=106.000
σ0.000
min2839.000-2733.000=106.000
max2839.000-2733.000=106.000
mean27.826-27.324=0.502
σ0.335-0.234=0.102
min27.517-27.087=0.430
max28.183-27.573=0.610