Compare commits

Home / Compare c2e467f1 .. 3b15a8f8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.976-33.980=-0.003
σ0.047-0.049=-0.002
min33.952-33.952=-0.001
max34.107-34.114=-0.007
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.080-0.085=-0.005
σ0.006-0.004=0.002
min0.075-0.082=-0.006
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.004-0.003=0.001
min23.312-23.314=-0.002
max23.323-23.321=0.001
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.063-0.063=-0.000
σ0.003-0.003=-0.000
min0.060-0.059=0.000
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.495-1757.494=0.001
σ0.365-0.365=-0.000
min1756.920-1756.920=-0.000
max1758.086-1758.085=0.002
mean1666.150-1658.050=8.100
σ621.362-618.163=3.198
min672.000-666.000=6.000
max2592.000-2586.000=6.000
mean2.346-2.364=-0.018
σ0.083-0.125=-0.042
min2.238-2.151=0.087
max2.528-2.743=-0.215

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.641-326.645=-0.004
σ0.030-0.029=0.001
min326.590-326.594=-0.004
max326.663-326.666=-0.003
mean2592.000-2586.000=6.000
σ0.000
min2592.000-2586.000=6.000
max2592.000-2586.000=6.000
mean0.424-0.422=0.002
σ0.004-0.001=0.003
min0.421-0.421=0.000
max0.430-0.423=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.804-1988.799=0.004
σ0.009-0.013=-0.004
min1988.788-1988.783=0.006
max1988.810-1988.814=-0.004
mean2592.000-2586.000=6.000
σ0.000
min2592.000-2586.000=6.000
max2592.000-2586.000=6.000
mean2.706-2.713=-0.007
σ0.112-0.146=-0.034
min2.588-2.594=-0.005
max2.854-2.956=-0.102
iters=5
new-facts=6402
prior-facts=1
mean4813.526-4813.221=0.305
σ7.775-7.962=-0.187
min4809.630-4809.014=0.615
max4827.427-4827.435=-0.008
mean2592.000-2586.000=6.000
σ0.000
min2592.000-2586.000=6.000
max2592.000-2586.000=6.000
mean8.816-8.703=0.112
σ0.157-0.563=-0.407
min8.617-7.736=0.881
max8.992-9.081=-0.089
iters=5
new-facts=6402
prior-facts=6402
mean5001.207-5001.202=0.005
σ0.033-0.020=0.013
min5001.175-5001.182=-0.007
max5001.257-5001.228=0.029
mean3005.000-2957.200=47.800
σ260.383-281.132=-20.749
min2619.000-2586.000=33.000
max3312.000-3326.000=-14.000
mean9.827-9.771=0.056
σ0.161-0.069=0.092
min9.596-9.681=-0.085
max10.042-9.868=0.174

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.250-1.274=-0.024
σ0.399-0.373=0.027
min0.912-0.936=-0.024
max1.765-1.783=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.637-464.629=0.008
σ574.790-574.776=0.013
min177.234-177.236=-0.002
max1326.821-1326.793=0.028
mean88.250
σ8.500
min84.000
max101.000
mean2592.000-2586.000=6.000
σ0.000
min2592.000-2586.000=6.000
max2592.000-2586.000=6.000
mean0.563-0.551=0.012
σ0.602-0.557=0.045
min0.253-0.271=-0.017
max1.466-1.386=0.080
policies=20
mean1772.679-1772.682=-0.004
σ0.362-0.362=0.000
min1772.437-1772.441=-0.005
max1773.216-1773.219=-0.004
mean840.000
σ0.000
min840.000
max840.000
mean2592.000-2586.000=6.000
σ0.000
min2592.000-2586.000=6.000
max2592.000-2586.000=6.000
mean2.727-2.732=-0.004
σ0.016-0.018=-0.001
min2.714-2.711=0.003
max2.750-2.754=-0.004
policies=200
mean17733.993-17734.064=-0.071
σ0.422-0.521=-0.100
min17733.685-17733.784=-0.099
max17734.616-17734.846=-0.230
mean8400.000
σ0.000
min8400.000
max8400.000
mean2592.000-2586.000=6.000
σ0.000
min2592.000-2586.000=6.000
max2592.000-2586.000=6.000
mean27.472-27.553=-0.081
σ0.172-0.151=0.021
min27.301-27.387=-0.086
max27.626-27.750=-0.124