Compare commits

Home / Compare 56dfc5bb .. 4ae262ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.978=-0.000
σ0.048-0.050=-0.002
min33.942-33.949=-0.007
max34.109-34.118=-0.008
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.084-0.082=0.002
σ0.003-0.004=-0.001
min0.079-0.077=0.002
max0.089-0.089=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.004-0.003=0.000
min23.313-23.313=0.000
max23.324-23.324=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.065=-0.000
σ0.004-0.002=0.002
min0.060-0.064=-0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.494=-0.000
σ0.363-0.365=-0.003
min1756.922-1756.922=-0.000
max1758.079-1758.086=-0.007
mean1645.650-1652.600=-6.950
σ635.338-633.770=1.568
min652.000-642.000=10.000
max2831.000-2837.000=-6.000
mean2.380-2.391=-0.012
σ0.116-0.105=0.011
min2.113-2.270=-0.157
max2.701-2.746=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.636-326.642=-0.006
σ0.056-0.034=0.022
min326.537-326.582=-0.046
max326.672-326.666=0.005
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean0.426-0.424=0.002
σ0.001-0.004=-0.003
min0.424-0.420=0.004
max0.428-0.429=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1988.782-1988.798=-0.016
σ0.014-0.016=-0.002
min1988.761-1988.775=-0.014
max1988.793-1988.810=-0.016
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean2.745-2.664=0.081
σ0.113-0.091=0.022
min2.612-2.557=0.054
max2.889-2.801=0.088
iters=5
new-facts=6402
prior-facts=1
mean4813.629-4813.652=-0.023
σ7.730-7.727=0.002
min4810.147-4810.136=0.011
max4827.456-4827.475=-0.018
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean8.653-8.912=-0.259
σ0.348-0.336=0.012
min8.107-8.609=-0.502
max9.008-9.392=-0.384
iters=5
new-facts=6402
prior-facts=6402
mean5001.057-5001.211=-0.154
σ0.330-0.033=0.297
min5000.467-5001.189=-0.722
max5001.227-5001.269=-0.042
mean3061.600-3040.200=21.400
σ242.524-205.214=37.310
min2831.000-2837.000=-6.000
max3412.000-3319.000=93.000
mean9.703-9.822=-0.119
σ0.197-0.325=-0.129
min9.453-9.321=0.131
max9.961-10.207=-0.246

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-0.998=0.088
σ0.253-0.064=0.190
min0.908-0.918=-0.010
max1.524-1.048=0.476

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.632-464.636=-0.004
σ574.767-574.769=-0.002
min177.239-177.241=-0.002
max1326.782-1326.789=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean0.436-0.435=0.002
σ0.298-0.302=-0.003
min0.282-0.282=-0.001
max0.884-0.887=-0.003
policies=20
mean1772.733-1772.725=0.008
σ0.370-0.361=0.009
min1772.462-1772.470=-0.007
max1773.275-1773.257=0.018
mean840.000
σ0.000
min840.000
max840.000
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean2.844-2.807=0.037
σ0.053-0.014=0.039
min2.801-2.789=0.012
max2.918-2.818=0.099
policies=200
mean17734.110-17733.891=0.219
σ0.479-0.503=-0.025
min17733.764-17733.475=0.290
max17734.812-17734.617=0.195
mean8400.000
σ0.000
min8400.000
max8400.000
mean2831.000-2837.000=-6.000
σ0.000
min2831.000-2837.000=-6.000
max2831.000-2837.000=-6.000
mean27.900-28.067=-0.166
σ0.345-0.381=-0.036
min27.516-27.606=-0.091
max28.237-28.495=-0.258