Compare commits

Home / Compare f85fbfd4 .. 04b0cc93

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.734-70.731=0.003
σ0.046-0.047=-0.001
min70.703-70.706=-0.003
max70.859-70.863=-0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.161-0.162=-0.001
σ0.003-0.003=0.000
min0.157-0.158=-0.001
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean21.465-21.464=0.001
σ0.004-0.003=0.001
min21.461-21.459=0.001
max21.471-21.467=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.459=-0.001
σ0.361-0.359=0.002
min1753.885-1753.889=-0.004
max1755.031-1755.020=0.011
mean1642.600-1672.400=-29.800
σ627.566-651.056=-23.489
min624.000
max2854.000-2839.000=15.000
mean2.806-2.831=-0.025
σ0.097-0.126=-0.030
min2.606-2.374=0.231
max2.941-2.972=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.500-273.506=-0.006
σ0.009-0.007=0.002
min273.489-273.498=-0.009
max273.512-273.513=-0.001
mean2854.000-2839.000=15.000
σ0.000
min2854.000-2839.000=15.000
max2854.000-2839.000=15.000
mean0.377-0.382=-0.005
σ0.005-0.005=0.000
min0.373-0.379=-0.006
max0.386-0.391=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.896-1933.886=0.010
σ0.014-0.013=0.000
min1933.880-1933.869=0.011
max1933.914-1933.900=0.015
mean2854.000-2839.000=15.000
σ0.000
min2854.000-2839.000=15.000
max2854.000-2839.000=15.000
mean2.937-2.953=-0.016
σ0.142-0.144=-0.002
min2.717-2.735=-0.018
max3.067-3.089=-0.022
iters=5
new-facts=6402
prior-facts=1
mean4754.713-4754.665=0.049
σ0.812-0.907=-0.094
min4754.252-4754.158=0.094
max4756.161-4756.278=-0.117
mean2854.000-2839.000=15.000
σ0.000
min2854.000-2839.000=15.000
max2854.000-2839.000=15.000
mean8.263-8.597=-0.335
σ0.392-0.390=0.002
min7.822-8.244=-0.423
max8.704-9.141=-0.437
iters=5
new-facts=6402
prior-facts=6402
mean4945.042-4945.044=-0.001
σ0.166-0.147=0.019
min4944.745-4944.781=-0.036
max4945.124-4945.113=0.010
mean3063.400-3054.000=9.400
σ285.895-211.039=74.856
min2854.000-2839.000=15.000
max3509.000-3324.000=185.000
mean8.446-8.615=-0.169
σ0.136-0.153=-0.017
min8.362-8.468=-0.106
max8.680-8.838=-0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.065-1.004=0.061
σ0.133-0.148=-0.016
min0.945-0.935=0.010
max1.267-1.269=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.572-472.579=-0.008
σ574.926-574.936=-0.010
min185.103-185.103=0.000
max1334.961-1334.984=-0.023
mean88.250
σ8.500
min84.000
max101.000
mean2854.000-2839.000=15.000
σ0.000
min2854.000-2839.000=15.000
max2854.000-2839.000=15.000
mean0.451-0.490=-0.039
σ0.306-0.381=-0.075
min0.297-0.298=-0.001
max0.910-1.061=-0.151
policies=20
mean1851.298-1851.302=-0.004
σ0.368-0.389=-0.021
min1851.033-1851.018=0.015
max1851.834-1851.872=-0.038
mean840.000
σ0.000
min840.000
max840.000
mean2854.000-2839.000=15.000
σ0.000
min2854.000-2839.000=15.000
max2854.000-2839.000=15.000
mean2.949-2.957=-0.009
σ0.019-0.024=-0.005
min2.935-2.939=-0.004
max2.976-2.990=-0.013
policies=200
mean18519.361-18519.453=-0.092
σ0.543-0.494=0.049
min18518.882-18519.165=-0.283
max18520.101-18520.191=-0.089
mean8400.000
σ0.000
min8400.000
max8400.000
mean2854.000-2839.000=15.000
σ0.000
min2854.000-2839.000=15.000
max2854.000-2839.000=15.000
mean29.178-29.127=0.051
σ0.392-0.498=-0.105
min28.958-28.837=0.121
max29.766-29.872=-0.106