Compare commits

Home / Compare 1c600705 .. e5621e35

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.050-0.049=0.002
min31.002-31.001=0.001
max31.182-31.175=0.007
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.079-0.075=0.004
σ0.004-0.004=-0.001
min0.075-0.070=0.004
max0.086-0.082=0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.001
σ0.002-0.002=-0.000
min21.140-21.140=-0.000
max21.146-21.147=-0.001
mean415.000-414.600=0.400
σ0.000-0.516=-0.516
min415.000-414.000=1.000
max415.000
mean0.064-0.064=-0.000
σ0.002-0.002=0.000
min0.062-0.062=0.000
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.414-1751.415=-0.001
σ0.360-0.362=-0.002
min1750.847-1750.845=0.002
max1751.998-1751.994=0.004
mean1634.500-1638.500=-4.000
σ595.323-616.688=-21.365
min631.000
max2417.000-2475.000=-58.000
mean2.813-2.879=-0.066
σ0.217-0.082=0.135
min2.340-2.686=-0.346
max3.062-3.050=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.784-266.786=-0.002
σ0.010-0.007=0.003
min266.770-266.778=-0.009
max266.797-266.794=0.003
mean2417.000-2475.000=-58.000
σ0.000
min2417.000-2475.000=-58.000
max2417.000-2475.000=-58.000
mean0.372-0.376=-0.003
σ0.000-0.007=-0.007
min0.372-0.371=0.001
max0.373-0.388=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1927.214-1927.210=0.004
σ0.014-0.005=0.008
min1927.202-1927.204=-0.002
max1927.231-1927.216=0.014
mean2417.000-2475.000=-58.000
σ0.000
min2417.000-2475.000=-58.000
max2417.000-2475.000=-58.000
mean3.026-3.003=0.024
σ0.067-0.040=0.027
min2.976-2.967=0.009
max3.109-3.065=0.044
iters=5
new-facts=6402
prior-facts=1
mean4747.748-4747.677=0.072
σ0.836-0.839=-0.003
min4747.283-4747.192=0.091
max4749.231-4749.167=0.064
mean2417.000-2475.000=-58.000
σ0.000
min2417.000-2475.000=-58.000
max2417.000-2475.000=-58.000
mean8.313-8.590=-0.278
σ0.574-0.484=0.090
min7.714-7.769=-0.055
max9.209-8.942=0.267
iters=5
new-facts=6402
prior-facts=6402
mean4938.170-4938.165=0.006
σ0.094-0.090=0.004
min4938.091-4938.083=0.008
max4938.277-4938.267=0.010
mean2951.800-2996.800=-45.000
σ383.722-285.924=97.797
min2490.000-2604.000=-114.000
max3446.000-3318.000=128.000
mean8.536-8.579=-0.043
σ0.261-0.216=0.044
min8.342-8.383=-0.041
max8.980-8.827=0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.866-1.764=0.102
σ0.046-0.188=-0.143
min1.821-1.448=0.373
max1.917-1.931=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.113-465.110=0.002
σ575.758-575.760=-0.002
min177.232-177.228=0.004
max1328.750-1328.750=-0.001
mean79.750
σ7.500
min76.000
max91.000
mean2417.000-2475.000=-58.000
σ0.000
min2417.000-2475.000=-58.000
max2417.000-2475.000=-58.000
mean0.549-0.581=-0.033
σ0.544-0.588=-0.044
min0.275-0.282=-0.006
max1.365-1.463=-0.098
policies=20
mean1772.585-1772.578=0.006
σ0.333-0.341=-0.008
min1772.366-1772.347=0.019
max1773.079-1773.084=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean2417.000-2475.000=-58.000
σ0.000
min2417.000-2475.000=-58.000
max2417.000-2475.000=-58.000
mean2.753-2.752=0.001
σ0.018-0.012=0.006
min2.732-2.742=-0.010
max2.775-2.765=0.010
policies=200
mean17732.592-17732.609=-0.017
σ0.432-0.514=-0.082
min17732.307-17732.251=0.056
max17733.228-17733.345=-0.117
mean7600.000
σ0.000
min7600.000
max7600.000
mean2417.000-2475.000=-58.000
σ0.000
min2417.000-2475.000=-58.000
max2417.000-2475.000=-58.000
mean27.847-27.713=0.134
σ0.152-0.097=0.056
min27.701-27.633=0.068
max28.061-27.854=0.207