Compare commits

Home / Compare 91e7d6db .. fd5671ba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=0.000
σ0.053-0.055=-0.002
min35.222-35.215=0.006
max35.394-35.398=-0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.081-0.085=-0.004
σ0.005-0.003=0.002
min0.076-0.082=-0.006
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.001
σ0.003-0.002=0.001
min23.766-23.765=0.002
max23.775-23.770=0.004
mean414.000-413.600=0.400
σ0.000-0.516=-0.516
min414.000-413.000=1.000
max414.000
mean0.068-0.066=0.002
σ0.004-0.006=-0.001
min0.061-0.060=0.000
max0.077-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.416-1756.365=-37.949
σ169.604-0.365=169.239
min997.851-1755.788=-757.936
max1756.950-1756.949=0.001
mean1631.750-1649.800=-18.050
σ599.163-641.535=-42.372
min651.000-626.000=25.000
max2443.000-2828.000=-385.000
mean2.266-2.334=-0.067
σ0.247-0.093=0.154
min1.251-2.244=-0.994
max2.464-2.610=-0.146

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.585-324.576=0.009
σ0.044-0.058=-0.013
min324.507-324.474=0.033
max324.616-324.609=0.007
mean2443.000-2828.000=-385.000
σ0.000
min2443.000-2828.000=-385.000
max2443.000-2828.000=-385.000
mean0.426-0.423=0.003
σ0.004-0.001=0.003
min0.424-0.422=0.002
max0.434-0.425=0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.145-1985.138=0.007
σ0.016-0.011=0.005
min1985.118-1985.121=-0.003
max1985.155-1985.148=0.007
mean2443.000-2828.000=-385.000
σ0.000
min2443.000-2828.000=-385.000
max2443.000-2828.000=-385.000
mean2.668-2.616=0.052
σ0.182-0.084=0.098
min2.511-2.535=-0.024
max2.959-2.738=0.221
iters=5
new-facts=6402
prior-facts=1
mean4808.746-4808.742=0.005
σ7.678-7.661=0.017
min4805.293-4805.263=0.029
max4822.481-4822.445=0.036
mean2443.000-2828.000=-385.000
σ0.000
min2443.000-2828.000=-385.000
max2443.000-2828.000=-385.000
mean8.968-8.941=0.027
σ0.103-0.149=-0.046
min8.889-8.747=0.142
max9.130-9.132=-0.003
iters=5
new-facts=6402
prior-facts=6402
mean4996.346-4996.270=0.076
σ0.012-0.159=-0.148
min4996.330-4995.988=0.342
max4996.358-4996.365=-0.007
mean2941.000-3030.800=-89.800
σ448.875-273.175=175.699
min2443.000-2828.000=-385.000
max3549.000-3460.000=89.000
mean8.589-8.499=0.091
σ0.126-0.147=-0.021
min8.456-8.422=0.033
max8.730-8.760=-0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.579-0.966=0.613
σ0.360-0.072=0.288
min0.942-0.902=0.040
max1.818-1.047=0.771

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.941-462.965=-0.024
σ574.252-574.247=0.004
min175.809-175.833=-0.025
max1324.318-1324.336=-0.017
mean86.250
σ8.500
min82.000
max99.000
mean2443.000-2828.000=-385.000
σ0.000
min2443.000-2828.000=-385.000
max2443.000-2828.000=-385.000
mean0.560-0.434=0.127
σ0.567-0.304=0.263
min0.272-0.278=-0.006
max1.411-0.889=0.522
policies=20
mean1758.485-1758.707=-0.222
σ0.340-0.344=-0.004
min1758.247-1758.483=-0.237
max1758.987-1759.218=-0.231
mean820.000
σ0.000
min820.000
max820.000
mean2443.000-2828.000=-385.000
σ0.000
min2443.000-2828.000=-385.000
max2443.000-2828.000=-385.000
mean2.702-2.784=-0.082
σ0.009-0.006=0.003
min2.695-2.777=-0.082
max2.713-2.789=-0.076
policies=200
mean17592.367-17593.331=-0.965
σ0.577-0.692=-0.115
min17591.991-17592.396=-0.405
max17593.215-17593.870=-0.655
mean8200.000
σ0.000
min8200.000
max8200.000
mean2443.000-2828.000=-385.000
σ0.000
min2443.000-2828.000=-385.000
max2443.000-2828.000=-385.000
mean27.471-27.840=-0.369
σ0.232-0.454=-0.222
min27.154-27.462=-0.308
max27.675-28.387=-0.712