Compare commits

Home / Compare 09791b3e .. 3b823d41

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.055-0.055=0.000
min35.588-35.587=0.001
max35.772-35.772=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.085-0.086=-0.001
σ0.003-0.003=-0.001
min0.083-0.083=-0.000
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.003-0.003=-0.001
min24.044-24.041=0.003
max24.052-24.054=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.068-0.062=0.006
σ0.003-0.002=0.001
min0.066-0.061=0.006
max0.076-0.069=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=-0.000
σ0.365-0.364=0.001
min1755.916-1755.916=-0.000
max1757.083-1757.082=0.000
mean1649.200-1648.300=0.900
σ641.720-633.250=8.470
min651.000-621.000=30.000
max2831.000-2832.000=-1.000
mean2.336-2.333=0.003
σ0.059-0.073=-0.014
min2.251-2.256=-0.004
max2.431-2.511=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.767-324.761=0.006
σ0.065-0.055=0.010
min324.651-324.662=-0.011
max324.803-324.791=0.012
mean2831.000-2832.000=-1.000
σ0.000
min2831.000-2832.000=-1.000
max2831.000-2832.000=-1.000
mean0.435-0.426=0.009
σ0.018-0.008=0.010
min0.419-0.421=-0.002
max0.460-0.440=0.020
iters=5
new-facts=1
prior-facts=6402
mean1985.329-1985.289=0.039
σ0.012-0.078=-0.066
min1985.308-1985.152=0.157
max1985.338-1985.338=-0.001
mean2831.000-2832.000=-1.000
σ0.000
min2831.000-2832.000=-1.000
max2831.000-2832.000=-1.000
mean2.680-2.565=0.115
σ0.156-0.096=0.060
min2.570-2.441=0.129
max2.935-2.682=0.253
iters=5
new-facts=6402
prior-facts=1
mean4809.081-4809.085=-0.004
σ7.720-7.717=0.002
min4805.577-4805.613=-0.036
max4822.891-4822.890=0.001
mean2831.000-2832.000=-1.000
σ0.000
min2831.000-2832.000=-1.000
max2831.000-2832.000=-1.000
mean8.780-9.008=-0.228
σ0.576-0.148=0.427
min7.763-8.861=-1.098
max9.182-9.249=-0.067
iters=5
new-facts=6402
prior-facts=6402
mean4996.555-4996.629=-0.073
σ0.171-0.026=0.145
min4996.252-4996.601=-0.350
max4996.649-4996.658=-0.009
mean3061.000-3049.400=11.600
σ302.388-289.074=13.314
min2831.000-2832.000=-1.000
max3529.000-3503.000=26.000
mean8.522-8.511=0.011
σ0.140-0.093=0.046
min8.425-8.414=0.011
max8.767-8.665=0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-1.075=-0.094
σ0.137-0.227=-0.090
min0.916-0.912=0.004
max1.226-1.464=-0.238

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-463.209=0.006
σ574.770-574.774=-0.004
min175.817-175.818=-0.001
max1325.370-1325.370=-0.000
mean86.250
σ8.500
min82.000
max99.000
mean2831.000-2832.000=-1.000
σ0.000
min2831.000-2832.000=-1.000
max2831.000-2832.000=-1.000
mean0.436-0.434=0.002
σ0.301-0.300=0.002
min0.285-0.279=0.006
max0.888-0.884=0.004
policies=20
mean1758.532-1758.500=0.032
σ0.349-0.348=0.001
min1758.289-1758.263=0.026
max1759.048-1759.016=0.032
mean820.000
σ0.000
min820.000
max820.000
mean2831.000-2832.000=-1.000
σ0.000
min2831.000-2832.000=-1.000
max2831.000-2832.000=-1.000
mean2.800-2.789=0.011
σ0.015-0.012=0.003
min2.790-2.779=0.011
max2.821-2.804=0.017
policies=200
mean17592.177-17592.101=0.077
σ0.431-0.411=0.020
min17591.923-17591.727=0.196
max17592.820-17592.674=0.146
mean8200.000
σ0.000
min8200.000
max8200.000
mean2831.000-2832.000=-1.000
σ0.000
min2831.000-2832.000=-1.000
max2831.000-2832.000=-1.000
mean27.874-27.860=0.013
σ0.421-0.377=0.043
min27.454-27.487=-0.033
max28.280-28.291=-0.010