Compare commits

Home / Compare 29ff3688 .. 419eb3fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.051-0.050=0.000
min33.942-33.943=-0.001
max34.118-34.118=-0.000
mean418.900-414.000=4.900
σ0.316-0.000=0.316
min418.000-414.000=4.000
max419.000-414.000=5.000
mean0.085-0.082=0.003
σ0.003-0.004=-0.001
min0.082-0.077=0.005
max0.091-0.088=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.004=-0.001
min23.314-23.312=0.002
max23.323-23.322=0.001
mean420.000-414.000=6.000
σ0.000
min420.000-414.000=6.000
max420.000-414.000=6.000
mean0.065-0.064=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.302=0.000
σ0.365-0.366=-0.001
min1756.728-1756.737=-0.009
max1757.887-1757.895=-0.008
mean1652.750-1653.450=-0.700
σ624.382-638.013=-13.631
min641.000-628.000=13.000
max2830.000-2757.000=73.000
mean2.395-2.417=-0.022
σ0.115-0.190=-0.075
min2.267-2.287=-0.021
max2.694-3.099=-0.404

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.453-326.445=0.008
σ0.039-0.053=-0.014
min326.385-326.352=0.033
max326.481-326.484=-0.002
mean2830.000-2757.000=73.000
σ0.000
min2830.000-2757.000=73.000
max2830.000-2757.000=73.000
mean0.427-0.424=0.003
σ0.004-0.002=0.002
min0.423-0.422=0.001
max0.433-0.426=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.617-1988.616=0.001
σ0.007-0.007=-0.000
min1988.610-1988.606=0.004
max1988.626-1988.623=0.002
mean2830.000-2757.000=73.000
σ0.000
min2830.000-2757.000=73.000
max2830.000-2757.000=73.000
mean2.674-2.683=-0.009
σ0.121-0.052=0.069
min2.528-2.626=-0.097
max2.856-2.761=0.095
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.496=-0.039
σ7.642-7.714=-0.072
min4809.965-4809.914=0.051
max4827.127-4827.294=-0.167
mean2830.000-2757.000=73.000
σ0.000
min2830.000-2757.000=73.000
max2830.000-2757.000=73.000
mean8.835-8.282=0.553
σ0.312-0.605=-0.292
min8.383-7.703=0.679
max9.142-9.197=-0.055
iters=5
new-facts=6402
prior-facts=6402
mean5000.945-5001.021=-0.076
σ0.166-0.034=0.131
min5000.649-5000.982=-0.333
max5001.035-5001.067=-0.032
mean3084.000-3014.400=69.600
σ253.010-320.136=-67.126
min2830.000-2757.000=73.000
max3336.000-3503.000=-167.000
mean9.714-9.634=0.080
σ0.376-0.594=-0.218
min9.081-8.595=0.486
max10.023-10.111=-0.088

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-0.950=0.051
σ0.068-0.058=0.010
min0.919-0.908=0.011
max1.053-1.050=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.439-464.433=0.007
σ574.771-574.776=-0.004
min177.044-177.041=0.003
max1326.596-1326.596=0.000
mean88.250
σ8.500
min84.000
max101.000
mean2830.000-2757.000=73.000
σ0.000
min2830.000-2757.000=73.000
max2830.000-2757.000=73.000
mean0.436-0.430=0.006
σ0.306-0.305=0.002
min0.282-0.277=0.004
max0.896-0.887=0.009
policies=20
mean1770.797-1770.846=-0.049
σ0.362-0.346=0.015
min1770.550-1770.565=-0.015
max1771.332-1771.326=0.006
mean840.000
σ0.000
min840.000
max840.000
mean2830.000-2757.000=73.000
σ0.000
min2830.000-2757.000=73.000
max2830.000-2757.000=73.000
mean2.800-2.837=-0.037
σ0.008-0.125=-0.118
min2.793-2.695=0.098
max2.811-3.000=-0.189
policies=200
mean17714.857-17714.796=0.061
σ0.560-0.557=0.002
min17714.324-17714.487=-0.163
max17715.646-17715.631=0.015
mean8400.000
σ0.000
min8400.000
max8400.000
mean2830.000-2757.000=73.000
σ0.000
min2830.000-2757.000=73.000
max2830.000-2757.000=73.000
mean28.022-27.500=0.522
σ0.468-0.149=0.319
min27.482-27.370=0.112
max28.581-27.650=0.930