Compare commits

Home / Compare 3d9d9ca3 .. a5e0f3c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.566=-0.004
σ0.045-0.043=0.002
min70.543-70.540=0.002
max70.689-70.685=0.004
mean414.000-412.700=1.300
σ0.000-0.483=-0.483
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.158-0.157=0.001
σ0.005-0.003=0.002
min0.150-0.155=-0.005
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.289-21.287=0.002
σ0.003-0.002=0.001
min21.283-21.283=-0.000
max21.295-21.290=0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.070-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.569=0.001
σ0.359-0.359=-0.000
min1752.998-1753.001=-0.003
max1754.159-1754.159=-0.000
mean1655.100-1652.850=2.250
σ645.290-645.434=-0.144
min628.000-641.000=-13.000
max2900.000-2886.000=14.000
mean2.814-2.826=-0.012
σ0.147-0.152=-0.005
min2.419-2.476=-0.057
max2.988-3.182=-0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.475-272.011=5.463
σ0.005-0.012=-0.007
min277.471-271.995=5.476
max277.482-272.022=5.460
mean2900.000-2886.000=14.000
σ0.000
min2900.000-2886.000=14.000
max2900.000-2886.000=14.000
mean0.393-0.390=0.003
σ0.005-0.006=-0.001
min0.388-0.384=0.005
max0.400-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1937.902-1932.447=5.456
σ0.011-0.019=-0.008
min1937.884-1932.425=5.459
max1937.912-1932.473=5.439
mean2900.000-2886.000=14.000
σ0.000
min2900.000-2886.000=14.000
max2900.000-2886.000=14.000
mean2.969-2.872=0.098
σ0.031-0.271=-0.240
min2.926-2.424=0.502
max2.999-3.088=-0.089
iters=5
new-facts=6402
prior-facts=1
mean4758.610-4753.142=5.468
σ0.918-0.923=-0.005
min4758.167-4752.667=5.499
max4760.250-4754.787=5.463
mean2900.000-2886.000=14.000
σ0.000
min2900.000-2886.000=14.000
max2900.000-2886.000=14.000
mean8.703-8.820=-0.118
σ0.222-0.291=-0.069
min8.394-8.478=-0.084
max8.966-9.155=-0.189
iters=5
new-facts=6402
prior-facts=6402
mean4949.109-4943.555=5.554
σ0.024-0.165=-0.141
min4949.082-4943.261=5.821
max4949.137-4943.646=5.491
mean3041.000-3067.400=-26.400
σ169.462-181.333=-11.871
min2900.000-2886.000=14.000
max3315.000-3309.000=6.000
mean8.634-8.664=-0.029
σ0.122-0.273=-0.151
min8.513-8.404=0.109
max8.825-9.016=-0.191

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.050=-0.033
σ0.117-0.185=-0.067
min0.935-0.933=0.002
max1.202-1.364=-0.163

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.082=-0.002
σ575.915-575.913=0.002
min185.120-185.118=0.002
max1336.952-1336.951=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2900.000-2886.000=14.000
σ0.000
min2900.000-2886.000=14.000
max2900.000-2886.000=14.000
mean0.488-0.446=0.041
σ0.380-0.295=0.085
min0.296-0.294=0.002
max1.058-0.889=0.168
policies=20
mean1851.459-1851.467=-0.008
σ0.378-0.380=-0.002
min1851.179-1851.178=0.001
max1852.011-1852.019=-0.008
mean840.000
σ0.000
min840.000
max840.000
mean2900.000-2886.000=14.000
σ0.000
min2900.000-2886.000=14.000
max2900.000-2886.000=14.000
mean2.927-2.942=-0.015
σ0.018-0.008=0.009
min2.905-2.931=-0.026
max2.947-2.949=-0.003
policies=200
mean18521.195-18521.104=0.091
σ0.414-0.596=-0.182
min18520.937-18520.762=0.175
max18521.806-18521.995=-0.190
mean8400.000
σ0.000
min8400.000
max8400.000
mean2900.000-2886.000=14.000
σ0.000
min2900.000-2886.000=14.000
max2900.000-2886.000=14.000
mean29.087-29.329=-0.242
σ0.423-0.403=0.020
min28.683-28.833=-0.150
max29.550-29.729=-0.179