Compare commits

Home / Compare 8a890626 .. 3d8101ee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.984=-0.004
σ0.052-0.051=0.001
min33.942-33.953=-0.011
max34.123-34.127=-0.005
mean414.000-411.800=2.200
σ0.000-0.422=-0.422
min414.000-411.000=3.000
max414.000-412.000=2.000
mean0.084-0.082=0.003
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.090-0.087=0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.324=-0.005
σ0.003-0.003=0.001
min23.314-23.321=-0.007
max23.326-23.329=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.066-0.064=0.002
σ0.003-0.005=-0.002
min0.064-0.059=0.005
max0.071-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1756.726=0.576
σ0.365-0.364=0.001
min1756.727-1756.154=0.573
max1757.891-1757.309=0.582
mean1646.950-1632.000=14.950
σ625.008-629.736=-4.728
min635.000
max2825.000-2833.000=-8.000
mean2.373-2.351=0.023
σ0.083-0.096=-0.013
min2.274-2.248=0.026
max2.581-2.636=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-325.326=1.127
σ0.031-0.030=0.001
min326.401-325.275=1.127
max326.477-325.352=1.125
mean2825.000-2833.000=-8.000
σ0.000
min2825.000-2833.000=-8.000
max2825.000-2833.000=-8.000
mean0.423-0.424=-0.001
σ0.003-0.001=0.002
min0.419-0.423=-0.003
max0.426-0.425=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.611-1985.876=2.736
σ0.009-0.010=-0.002
min1988.600-1985.857=2.743
max1988.621-1985.882=2.739
mean2825.000-2833.000=-8.000
σ0.000
min2825.000-2833.000=-8.000
max2825.000-2833.000=-8.000
mean2.703-2.709=-0.007
σ0.067-0.109=-0.042
min2.643-2.577=0.066
max2.783-2.862=-0.079
iters=5
new-facts=6402
prior-facts=1
mean4813.259-4809.655=3.604
σ7.852-7.663=0.188
min4808.982-4806.105=2.877
max4827.281-4823.362=3.919
mean2825.000-2833.000=-8.000
σ0.000
min2825.000-2833.000=-8.000
max2825.000-2833.000=-8.000
mean8.350-8.654=-0.304
σ0.599-0.485=0.114
min7.754-7.809=-0.055
max9.152-9.039=0.113
iters=5
new-facts=6402
prior-facts=6402
mean5000.864-4997.184=3.679
σ0.199-0.023=0.176
min5000.630-4997.161=3.469
max5001.043-4997.214=3.829
mean3067.200-3050.800=16.400
σ319.920-291.054=28.866
min2825.000-2833.000=-8.000
max3556.000-3507.000=49.000
mean9.093-8.504=0.589
σ0.492-0.077=0.415
min8.479-8.430=0.049
max9.693-8.635=1.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.950-0.965=-0.015
σ0.061-0.072=-0.011
min0.912-0.900=0.011
max1.058-1.047=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-463.381=1.061
σ574.774-574.771=0.003
min177.041-175.984=1.057
max1326.601-1325.537=1.065
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2825.000-2833.000=-8.000
σ0.000
min2825.000-2833.000=-8.000
max2825.000-2833.000=-8.000
mean0.442-0.470=-0.028
σ0.314-0.376=-0.061
min0.281-0.280=0.001
max0.913-1.033=-0.120
policies=20
mean1770.801-1760.154=10.647
σ0.366-0.355=0.011
min1770.552-1759.912=10.641
max1771.343-1760.681=10.663
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2825.000-2833.000=-8.000
σ0.000
min2825.000-2833.000=-8.000
max2825.000-2833.000=-8.000
mean2.799-2.790=0.009
σ0.024-0.007=0.017
min2.773-2.781=-0.008
max2.830-2.797=0.033
policies=200
mean17714.854-17608.441=106.413
σ0.543-0.492=0.052
min17714.430-17608.060=106.369
max17715.642-17609.163=106.479
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2825.000-2833.000=-8.000
σ0.000
min2825.000-2833.000=-8.000
max2825.000-2833.000=-8.000
mean27.940-27.744=0.196
σ0.378-0.384=-0.006
min27.623-27.324=0.299
max28.372-28.094=0.279