Compare commits

Home / Compare 33d1b4f9 .. d138311a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.049-0.050=-0.001
min33.945-33.946=-0.001
max34.114-34.116=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.001
min0.077-0.083=-0.006
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.002
σ0.003-0.004=-0.000
min23.313-23.314=-0.001
max23.322-23.324=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.066=-0.002
σ0.004-0.002=0.001
min0.059-0.064=-0.005
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.495-1757.495=0.000
σ0.366-0.364=0.001
min1756.922-1756.920=0.003
max1758.086-1758.084=0.002
mean1650.000-1665.200=-15.200
σ626.540-628.129=-1.589
min638.000-668.000=-30.000
max2833.000-2613.000=220.000
mean2.362-2.370=-0.008
σ0.092-0.116=-0.025
min2.238-2.199=0.039
max2.677-2.696=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.636-326.643=-0.007
σ0.054-0.035=0.020
min326.540-326.584=-0.044
max326.675-326.674=0.000
mean2833.000-2613.000=220.000
σ0.000
min2833.000-2613.000=220.000
max2833.000-2613.000=220.000
mean0.425-0.422=0.003
σ0.002-0.001=0.001
min0.422-0.421=0.002
max0.428-0.424=0.003
iters=5
new-facts=1
prior-facts=6402
mean1988.804-1988.798=0.007
σ0.011-0.019=-0.008
min1988.789-1988.769=0.020
max1988.820-1988.814=0.006
mean2833.000-2613.000=220.000
σ0.000
min2833.000-2613.000=220.000
max2833.000-2613.000=220.000
mean2.661-2.698=-0.037
σ0.081-0.109=-0.028
min2.556-2.607=-0.051
max2.779-2.887=-0.108
iters=5
new-facts=6402
prior-facts=1
mean4813.659-4813.657=0.003
σ7.717-7.755=-0.038
min4810.106-4810.173=-0.067
max4827.464-4827.529=-0.065
mean2833.000-2613.000=220.000
σ0.000
min2833.000-2613.000=220.000
max2833.000-2613.000=220.000
mean8.892-9.012=-0.120
σ0.334-0.384=-0.049
min8.479-8.515=-0.035
max9.262-9.561=-0.299
iters=5
new-facts=6402
prior-facts=6402
mean5001.202-5001.074=0.128
σ0.029-0.337=-0.308
min5001.161-5000.472=0.689
max5001.230-5001.245=-0.015
mean3032.200-2958.800=73.400
σ205.982-266.533=-60.550
min2833.000-2613.000=220.000
max3323.000-3306.000=17.000
mean9.570-9.722=-0.152
σ0.646-0.586=0.061
min8.446-8.712=-0.266
max10.107-10.134=-0.027

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.946-1.303=-0.357
σ0.058-0.400=-0.342
min0.911-0.941=-0.029
max1.048-1.811=-0.763

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.630-464.635=-0.006
σ574.770-574.789=-0.019
min177.238-177.237=0.002
max1326.784-1326.819=-0.035
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2613.000=220.000
σ0.000
min2833.000-2613.000=220.000
max2833.000-2613.000=220.000
mean0.432-0.558=-0.126
σ0.306-0.559=-0.253
min0.276-0.278=-0.002
max0.892-1.397=-0.505
policies=20
mean1772.725-1772.677=0.048
σ0.368-0.350=0.018
min1772.468-1772.447=0.021
max1773.269-1773.196=0.073
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2613.000=220.000
σ0.000
min2833.000-2613.000=220.000
max2833.000-2613.000=220.000
mean2.802-2.712=0.090
σ0.009-0.025=-0.016
min2.790-2.686=0.105
max2.811-2.746=0.066
policies=200
mean17734.117-17733.951=0.167
σ0.435-0.586=-0.151
min17733.820-17733.570=0.249
max17734.763-17734.819=-0.055
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2613.000=220.000
σ0.000
min2833.000-2613.000=220.000
max2833.000-2613.000=220.000
mean27.899-27.554=0.346
σ0.346-0.082=0.265
min27.578-27.442=0.136
max28.299-27.625=0.674