Compare commits

Home / Compare 2dfee8b2 .. 5010fef9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.049-0.048=0.001
min33.950-33.949=0.001
max34.115-34.112=0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.084-0.082=0.002
σ0.003-0.005=-0.002
min0.082-0.077=0.005
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.003-0.003=-0.000
min23.314-23.313=0.001
max23.322-23.322=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.063-0.064=-0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.493=0.001
σ0.365-0.365=-0.000
min1756.921-1756.920=0.001
max1758.083-1758.086=-0.003
mean1666.150-1648.150=18.000
σ641.753-625.143=16.610
min674.000-638.000=36.000
max2639.000-2837.000=-198.000
mean2.386-2.374=0.011
σ0.088-0.083=0.005
min2.264-2.278=-0.014
max2.547-2.630=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.634-326.643=-0.008
σ0.051-0.046=0.005
min326.545-326.562=-0.017
max326.669-326.672=-0.003
mean2639.000-2837.000=-198.000
σ0.000
min2639.000-2837.000=-198.000
max2639.000-2837.000=-198.000
mean0.424-0.422=0.002
σ0.004-0.001=0.003
min0.420-0.422=-0.002
max0.429-0.423=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.809-1988.805=0.004
σ0.007-0.014=-0.008
min1988.803-1988.780=0.022
max1988.819-1988.817=0.002
mean2639.000-2837.000=-198.000
σ0.000
min2639.000-2837.000=-198.000
max2639.000-2837.000=-198.000
mean2.685-2.722=-0.037
σ0.052-0.106=-0.054
min2.643-2.611=0.032
max2.768-2.852=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4813.585-4813.642=-0.057
σ7.766-7.727=0.040
min4809.665-4810.129=-0.464
max4827.469-4827.463=0.005
mean2639.000-2837.000=-198.000
σ0.000
min2639.000-2837.000=-198.000
max2639.000-2837.000=-198.000
mean8.221-8.703=-0.482
σ0.562-0.267=0.296
min7.690-8.463=-0.773
max9.136-9.125=0.011
iters=5
new-facts=6402
prior-facts=6402
mean5001.060-5001.136=-0.076
σ0.197-0.170=0.027
min5000.830-5000.833=-0.003
max5001.216-5001.232=-0.016
mean2953.800-3009.400=-55.600
σ350.814-196.693=154.121
min2639.000-2837.000=-198.000
max3458.000-3317.000=141.000
mean9.532-9.754=-0.222
σ0.588-0.203=0.385
min8.494-9.535=-1.041
max9.938-9.976=-0.038

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.234-1.000=0.234
σ0.284-0.124=0.160
min1.038-0.916=0.122
max1.713-1.201=0.512

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.627-464.635=-0.008
σ574.786-574.770=0.016
min177.231-177.243=-0.012
max1326.806-1326.790=0.016
mean88.250
σ8.500
min84.000
max101.000
mean2639.000-2837.000=-198.000
σ0.000
min2639.000-2837.000=-198.000
max2639.000-2837.000=-198.000
mean0.555-0.434=0.121
σ0.560-0.311=0.249
min0.271-0.277=-0.006
max1.394-0.900=0.495
policies=20
mean1772.681-1772.735=-0.054
σ0.358-0.359=-0.001
min1772.430-1772.475=-0.045
max1773.210-1773.260=-0.049
mean840.000
σ0.000
min840.000
max840.000
mean2639.000-2837.000=-198.000
σ0.000
min2639.000-2837.000=-198.000
max2639.000-2837.000=-198.000
mean2.717-2.788=-0.071
σ0.015-0.003=0.012
min2.697-2.785=-0.088
max2.731-2.792=-0.061
policies=200
mean17734.068-17734.159=-0.091
σ0.369-0.423=-0.054
min17733.849-17733.890=-0.042
max17734.620-17734.789=-0.169
mean8400.000
σ0.000
min8400.000
max8400.000
mean2639.000-2837.000=-198.000
σ0.000
min2639.000-2837.000=-198.000
max2639.000-2837.000=-198.000
mean27.517-27.952=-0.435
σ0.092-0.369=-0.277
min27.385-27.568=-0.183
max27.585-28.381=-0.796