Compare commits

Home / Compare 080c2b32 .. 735003af

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.051-0.051=0.000
min33.942-33.942=0.000
max34.121-34.121=0.000
mean411.000-420.000=-9.000
σ0.000
min411.000-420.000=-9.000
max411.000-420.000=-9.000
mean0.084-0.085=-0.001
σ0.003-0.003=-0.000
min0.082-0.083=-0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.004-0.003=0.001
min23.313-23.315=-0.002
max23.328-23.324=0.004
mean411.000-421.000=-10.000
σ0.000
min411.000-421.000=-10.000
max411.000-421.000=-10.000
mean0.064-0.065=-0.001
σ0.005-0.003=0.002
min0.060-0.063=-0.003
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.301=0.000
σ0.364-0.365=-0.001
min1756.730-1756.726=0.004
max1757.893-1757.893=-0.000
mean1643.850-1664.650=-20.800
σ624.447-619.884=4.563
min634.000-670.000=-36.000
max2829.000-2604.000=225.000
mean2.346-2.358=-0.011
σ0.088-0.135=-0.047
min2.251-2.231=0.020
max2.595-2.693=-0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.456-326.454=0.003
σ0.031-0.020=0.010
min326.402-326.420=-0.018
max326.475-326.471=0.004
mean2829.000-2604.000=225.000
σ0.000
min2829.000-2604.000=225.000
max2829.000-2604.000=225.000
mean0.433-0.427=0.005
σ0.012-0.006=0.006
min0.423-0.423=0.001
max0.452-0.435=0.018
iters=5
new-facts=1
prior-facts=6402
mean1988.609-1988.618=-0.008
σ0.020-0.003=0.017
min1988.576-1988.614=-0.038
max1988.625-1988.623=0.002
mean2829.000-2604.000=225.000
σ0.000
min2829.000-2604.000=225.000
max2829.000-2604.000=225.000
mean2.669-2.668=0.001
σ0.039-0.077=-0.038
min2.621-2.545=0.077
max2.730-2.748=-0.018
iters=5
new-facts=6402
prior-facts=1
mean4813.329-4813.451=-0.121
σ7.790-7.711=0.079
min4809.483-4809.951=-0.468
max4827.259-4827.244=0.015
mean2829.000-2604.000=225.000
σ0.000
min2829.000-2604.000=225.000
max2829.000-2604.000=225.000
mean8.811-8.704=0.107
σ0.215-0.345=-0.130
min8.535-8.347=0.188
max8.984-9.083=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean5000.890-5001.006=-0.115
σ0.191-0.027=0.165
min5000.674-5000.973=-0.299
max5001.047-5001.036=0.012
mean3031.600-2997.600=34.000
σ205.247-261.667=-56.420
min2829.000-2611.000=218.000
max3312.000-3308.000=4.000
mean9.874-9.631=0.243
σ0.539-0.445=0.095
min8.930-8.864=0.067
max10.253-9.949=0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.946-1.176=-0.230
σ0.060-0.398=-0.337
min0.910-0.922=-0.011
max1.052-1.843=-0.791

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.433-464.433=-0.000
σ574.774-574.780=-0.006
min177.042-177.036=0.006
max1326.594-1326.603=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2829.000-2604.000=225.000
σ0.000
min2829.000-2604.000=225.000
max2829.000-2604.000=225.000
mean0.433-0.560=-0.128
σ0.301-0.576=-0.275
min0.279-0.265=0.014
max0.884-1.424=-0.540
policies=20
mean1770.797-1770.752=0.045
σ0.363-0.367=-0.004
min1770.548-1770.504=0.044
max1771.333-1771.296=0.036
mean840.000
σ0.000
min840.000
max840.000
mean2829.000-2604.000=225.000
σ0.000
min2829.000-2604.000=225.000
max2829.000-2604.000=225.000
mean2.802-2.730=0.072
σ0.018-0.013=0.005
min2.783-2.717=0.065
max2.818-2.748=0.069
policies=200
mean17714.834-17714.967=-0.133
σ0.593-0.501=0.092
min17714.347-17714.663=-0.316
max17715.688-17715.716=-0.028
mean8400.000
σ0.000
min8400.000
max8400.000
mean2829.000-2604.000=225.000
σ0.000
min2829.000-2604.000=225.000
max2829.000-2604.000=225.000
mean27.886-27.437=0.449
σ0.685-0.150=0.535
min27.234-27.256=-0.022
max28.767-27.622=1.145