Compare commits

Home / Compare ae2d4e97 .. 9d1f6020

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.047-0.049=-0.002
min33.952-33.948=0.005
max34.110-34.115=-0.004
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.084-0.084=0.000
σ0.003-0.003=-0.000
min0.082-0.082=0.000
max0.090-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.000
σ0.003-0.003=-0.000
min23.314-23.313=0.000
max23.321-23.323=-0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.064-0.065=-0.001
σ0.005-0.002=0.003
min0.060-0.064=-0.004
max0.073-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.429=0.001
σ0.365-0.363=0.002
min1756.855-1756.857=-0.003
max1758.025-1758.018=0.007
mean1644.500-1673.300=-28.800
σ625.072-640.965=-15.893
min634.000-683.000=-49.000
max2832.000-2648.000=184.000
mean2.362-2.386=-0.024
σ0.093-0.111=-0.017
min2.245-2.222=0.023
max2.674-2.694=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.573=-0.002
σ0.062-0.052=0.010
min326.462-326.482=-0.021
max326.616-326.614=0.003
mean2832.000-2648.000=184.000
σ0.000
min2832.000-2648.000=184.000
max2832.000-2648.000=184.000
mean0.423-0.429=-0.006
σ0.026-0.007=0.020
min0.379-0.425=-0.046
max0.448-0.441=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.727-1988.726=0.001
σ0.006-0.019=-0.013
min1988.721-1988.704=0.017
max1988.735-1988.754=-0.020
mean2832.000-2648.000=184.000
σ0.000
min2832.000-2648.000=184.000
max2832.000-2648.000=184.000
mean2.665-2.841=-0.176
σ0.057-0.284=-0.226
min2.577-2.607=-0.030
max2.729-3.330=-0.601
iters=5
new-facts=6402
prior-facts=1
mean4813.455-4813.603=-0.149
σ7.484-7.726=-0.242
min4810.074-4810.079=-0.005
max4826.842-4827.422=-0.580
mean2832.000-2648.000=184.000
σ0.000
min2832.000-2648.000=184.000
max2832.000-2648.000=184.000
mean8.891-8.766=0.125
σ0.274-0.471=-0.197
min8.534-8.016=0.518
max9.293-9.241=0.052
iters=5
new-facts=6402
prior-facts=6402
mean5001.145-5001.074=0.072
σ0.025-0.176=-0.150
min5001.119-5000.760=0.359
max5001.185-5001.168=0.017
mean3042.800-3035.400=7.400
σ189.096-318.069=-128.973
min2832.000-2648.000=184.000
max3310.000-3338.000=-28.000
mean9.860-9.601=0.259
σ0.156-0.534=-0.378
min9.714-8.817=0.897
max10.060-10.312=-0.253

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.943-1.169=-0.226
σ0.059-0.366=-0.307
min0.906-0.912=-0.006
max1.045-1.803=-0.758

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.565-464.563=0.002
σ574.773-574.782=-0.009
min177.174-177.168=0.006
max1326.724-1326.736=-0.012
mean88.250
σ8.500
min84.000
max101.000
mean2832.000-2648.000=184.000
σ0.000
min2832.000-2648.000=184.000
max2832.000-2648.000=184.000
mean0.432-0.536=-0.103
σ0.303-0.518=-0.215
min0.278-0.274=0.004
max0.887-1.314=-0.426
policies=20
mean1772.074-1772.042=0.032
σ0.355-0.360=-0.005
min1771.828-1771.811=0.017
max1772.599-1772.577=0.022
mean840.000
σ0.000
min840.000
max840.000
mean2832.000-2648.000=184.000
σ0.000
min2832.000-2648.000=184.000
max2832.000-2648.000=184.000
mean2.798-2.728=0.071
σ0.007-0.012=-0.006
min2.792-2.710=0.082
max2.807-2.739=0.068
policies=200
mean17727.669-17727.493=0.175
σ0.445-0.606=-0.161
min17727.343-17727.115=0.228
max17728.325-17728.394=-0.068
mean8400.000
σ0.000
min8400.000
max8400.000
mean2832.000-2648.000=184.000
σ0.000
min2832.000-2648.000=184.000
max2832.000-2648.000=184.000
mean28.080-27.682=0.397
σ0.373-0.271=0.102
min27.710-27.461=0.249
max28.493-28.014=0.479