Compare commits

Home / Compare 7c2f890b .. 7d14e18e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045
σ0.047
min73.023
max73.179
mean414.000
σ0.000
min414.000
max414.000
mean0.160
σ0.003
min0.156
max0.167
cache=y
dps=1
iters=10
policies=100
mean23.741
σ0.002
min23.737
max23.745
mean414.000
σ0.000
min414.000
max414.000
mean0.066
σ0.003
min0.064
max0.073

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1755.329=3.457
σ0.361-0.367=-0.006
min1758.214-1754.756=3.458
max1759.373-1755.916=3.457
mean1620.350-1642.500=-22.150
σ596.031-622.142=-26.110
min648.000-609.000=39.000
max2411.000-2638.000=-227.000
mean2.866-2.263=0.602
σ0.158-0.113=0.045
min2.506-2.138=0.368
max3.271-2.596=0.674

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-277.719=46.292
σ0.055-0.010=0.044
min323.913-277.703=46.211
max324.040-277.731=46.309
mean2411.000-2638.000=-227.000
σ0.000
min2411.000-2638.000=-227.000
max2411.000-2638.000=-227.000
mean0.430-0.407=0.023
σ0.005-0.002=0.003
min0.424-0.404=0.021
max0.438-0.408=0.029
iters=5
new-facts=1
prior-facts=6402
mean1984.589-2267.891=-283.302
σ0.016-0.005=0.012
min1984.563-2267.887=-283.325
max1984.602-2267.899=-283.297
mean2411.000-2638.000=-227.000
σ0.000
min2411.000-2638.000=-227.000
max2411.000-2638.000=-227.000
mean2.623-2.894=-0.271
σ0.077-0.071=0.006
min2.558-2.801=-0.243
max2.724-2.997=-0.273
iters=5
new-facts=6402
prior-facts=1
mean4808.135-4954.941=-146.806
σ7.847-0.920=6.927
min4804.268-4954.117=-149.849
max4822.166-4956.514=-134.348
mean2411.000-2638.000=-227.000
σ0.000
min2411.000-2638.000=-227.000
max2411.000-2638.000=-227.000
mean8.953-7.988=0.965
σ0.216-0.289=-0.073
min8.661-7.657=1.004
max9.255-8.405=0.849
iters=5
new-facts=6402
prior-facts=6402
mean4995.663-5169.717=-174.054
σ0.306-0.137=0.168
min4995.117-5169.513=-174.396
max4995.826-5169.849=-174.023
mean2947.600-3453.600=-506.000
σ419.529-454.626=-35.097
min2413.000-2800.000=-387.000
max3440.000-3984.000=-544.000
mean8.539-9.387=-0.848
σ0.169-0.243=-0.074
min8.439-9.114=-0.675
max8.839-9.710=-0.871

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.812-1.010=0.802
σ0.034-0.169=-0.135
min1.759-0.933=0.827
max1.851-1.313=0.538

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.321-456.316=12.004
σ574.227-572.593=1.634
min181.204-170.018=11.186
max1329.662-1315.206=14.456
mean88.250-79.500=8.750
σ8.500-7.000=1.500
min84.000-76.000=8.000
max101.000-90.000=11.000
mean2411.000-430.500=1980.500
σ0.000-0.577=-0.577
min2411.000-430.000=1981.000
max2411.000-431.000=1980.000
mean0.561-0.532=0.029
σ0.554-0.536=0.018
min0.282-0.259=0.023
max1.392-1.336=0.056
policies=20
mean1812.416-1700.730=111.686
σ0.390-0.301=0.089
min1812.157-1700.506=111.651
max1812.993-1701.169=111.824
mean840.000-760.000=80.000
σ0.000
min840.000-760.000=80.000
max840.000-760.000=80.000
mean2411.000-443.750=1967.250
σ0.000-11.057=-11.057
min2411.000-431.000=1980.000
max2411.000-453.000=1958.000
mean2.830-2.607=0.223
σ0.024-0.013=0.011
min2.802-2.597=0.205
max2.855-2.625=0.230
policies=200
mean18131.331-17016.734=1114.597
σ0.376-0.069=0.307
min18131.084-17016.645=1114.440
max18131.890-17016.803=1115.088
mean8400.000-7600.000=800.000
σ0.000
min8400.000-7600.000=800.000
max8400.000-7600.000=800.000
mean2411.000-488.750=1922.250
σ0.000-1.708=-1.708
min2411.000-487.000=1924.000
max2411.000-491.000=1920.000
mean28.439-26.282=2.157
σ0.131-0.033=0.098
min28.312-26.238=2.075
max28.610-26.317=2.293