Compare commits

Home / Compare d3737f25 .. 29299a1c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.263=0.355
σ0.054-0.054=0.000
min35.593-35.239=0.355
max35.771-35.414=0.357
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.084=0.001
σ0.003-0.005=-0.002
min0.082-0.077=0.005
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.048-23.769=0.279
σ0.002-0.003=-0.000
min24.045-23.764=0.281
max24.052-23.774=0.277
mean414.000
σ0.000
min414.000
max414.000
mean0.068-0.067=0.001
σ0.003-0.003=-0.000
min0.066-0.060=0.005
max0.074-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.471=0.020
σ0.365-0.366=-0.002
min1755.917-1755.894=0.023
max1757.080-1757.065=0.014
mean1654.000-1652.650=1.350
σ641.406-643.702=-2.296
min630.000-627.000=3.000
max2847.000-2840.000=7.000
mean2.365-2.314=0.050
σ0.113-0.074=0.038
min2.233-2.152=0.081
max2.624-2.457=0.167

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.691=0.071
σ0.056-0.056=0.001
min324.662-324.591=0.071
max324.800-324.723=0.077
mean2847.000-2840.000=7.000
σ0.000
min2847.000-2840.000=7.000
max2847.000-2840.000=7.000
mean0.432-0.424=0.008
σ0.008-0.003=0.005
min0.422-0.422=0.001
max0.440-0.429=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.239=0.078
σ0.016-0.014=0.003
min1985.291-1985.223=0.068
max1985.330-1985.259=0.071
mean2847.000-2840.000=7.000
σ0.000
min2847.000-2840.000=7.000
max2847.000-2840.000=7.000
mean2.621-2.577=0.043
σ0.068-0.090=-0.022
min2.551-2.468=0.082
max2.715-2.697=0.019
iters=5
new-facts=6402
prior-facts=1
mean4809.106-4808.748=0.359
σ7.628-7.753=-0.126
min4805.595-4804.811=0.784
max4822.749-4822.609=0.141
mean2847.000-2840.000=7.000
σ0.000
min2847.000-2840.000=7.000
max2847.000-2840.000=7.000
mean8.935-8.687=0.247
σ0.456-0.256=0.200
min8.367-8.306=0.062
max9.633-8.951=0.681
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.453=0.176
σ0.023-0.019=0.004
min4996.598-4996.427=0.171
max4996.653-4996.471=0.182
mean3056.600-3031.600=25.000
σ226.085-263.215=-37.131
min2847.000-2840.000=7.000
max3393.000-3448.000=-55.000
mean8.751-8.483=0.269
σ0.170-0.034=0.136
min8.496-8.441=0.055
max8.958-8.534=0.424

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.923-0.946=-0.023
σ0.014-0.055=-0.041
min0.912-0.913=-0.001
max0.947-1.041=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.946=0.262
σ574.766-574.247=0.519
min175.818-175.817=0.001
max1325.356-1324.317=1.040
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2840.000=7.000
σ0.000
min2847.000-2840.000=7.000
max2847.000-2840.000=7.000
mean0.423-0.418=0.005
σ0.292-0.273=0.019
min0.271-0.281=-0.010
max0.861-0.828=0.033
policies=20
mean1758.519-1758.493=0.027
σ0.350-0.349=0.001
min1758.301-1758.279=0.022
max1759.040-1759.012=0.029
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2840.000=7.000
σ0.000
min2847.000-2840.000=7.000
max2847.000-2840.000=7.000
mean2.780-2.782=-0.002
σ0.007-0.014=-0.007
min2.771-2.765=0.007
max2.788-2.799=-0.011
policies=200
mean17592.188-17591.012=1.176
σ0.486-0.683=-0.197
min17591.867-17590.095=1.773
max17592.911-17591.668=1.243
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2840.000=7.000
σ0.000
min2847.000-2840.000=7.000
max2847.000-2840.000=7.000
mean27.898-27.828=0.070
σ0.342-0.381=-0.039
min27.428-27.347=0.081
max28.189-28.226=-0.037