Compare commits

Home / Compare 3ccc0b21 .. b58a0efa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.107-0.108=-0.001
min35.929-35.925=0.005
max36.277-36.280=-0.003
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.077-0.074=0.003
σ0.003-0.005=-0.002
min0.075-0.070=0.005
max0.083-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.004-0.004=0.000
min26.201-26.202=-0.001
max26.214-26.215=-0.000
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.061-0.060=0.001
σ0.003-0.004=-0.001
min0.059-0.056=0.002
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.365=-0.001
σ0.371-0.370=0.001
min1757.784-1757.791=-0.006
max1758.962-1758.960=0.002
mean1657.400-1652.950=4.450
σ619.868-649.610=-29.742
min688.000-669.000=19.000
max2745.000-2753.000=-8.000
mean2.363-2.366=-0.003
σ0.084-0.106=-0.022
min2.267-2.174=0.093
max2.599-2.646=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.513-279.509=0.004
σ0.009-0.006=0.002
min279.501-279.501=-0.000
max279.523-279.515=0.008
mean2745.000-2753.000=-8.000
σ0.000
min2745.000-2753.000=-8.000
max2745.000-2753.000=-8.000
mean0.412-0.408=0.004
σ0.007-0.007=0.000
min0.405-0.404=0.001
max0.419-0.420=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2178.436-2178.438=-0.002
σ0.028-0.014=0.014
min2178.388-2178.426=-0.038
max2178.458-2178.462=-0.004
mean2745.000-2753.000=-8.000
σ0.000
min2745.000-2753.000=-8.000
max2745.000-2753.000=-8.000
mean3.458-3.347=0.111
σ0.126-0.123=0.003
min3.265-3.225=0.040
max3.572-3.532=0.040
iters=5
new-facts=6402
prior-facts=1
mean5056.390-5056.368=0.022
σ0.962-0.980=-0.018
min5055.925-5055.761=0.165
max5058.110-5058.104=0.006
mean2745.000-2753.000=-8.000
σ0.000
min2745.000-2753.000=-8.000
max2745.000-2753.000=-8.000
mean8.552-9.120=-0.567
σ0.495-0.536=-0.041
min8.178-8.210=-0.032
max9.412-9.581=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean5193.757-5193.760=-0.003
σ0.087-0.090=-0.004
min5193.690-5193.686=0.004
max5193.858-5193.860=-0.002
mean3291.600-3241.400=50.200
σ392.997-340.469=52.528
min2745.000-2753.000=-8.000
max3662.000-3683.000=-21.000
mean9.003-9.028=-0.024
σ0.242-0.390=-0.148
min8.759-8.747=0.012
max9.401-9.700=-0.300

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-0.978=0.028
σ0.069-0.063=0.006
min0.946-0.941=0.005
max1.088-1.088=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.479-465.492=-0.013
σ572.662-572.681=-0.019
min179.142-179.139=0.002
max1324.473-1324.514=-0.042
mean79.500
σ7.000
min76.000
max90.000
mean2745.000-2753.000=-8.000
σ0.000
min2745.000-2753.000=-8.000
max2745.000-2753.000=-8.000
mean0.496-0.563=-0.067
σ0.424-0.563=-0.139
min0.283-0.278=0.006
max1.132-1.407=-0.274
policies=20
mean1791.682-1791.697=-0.015
σ0.339-0.342=-0.004
min1791.490-1791.478=0.012
max1792.188-1792.206=-0.018
mean760.000
σ0.000
min760.000
max760.000
mean2745.000-2753.000=-8.000
σ0.000
min2745.000-2753.000=-8.000
max2745.000-2753.000=-8.000
mean2.785-2.808=-0.023
σ0.009-0.007=0.002
min2.772-2.804=-0.033
max2.791-2.819=-0.027
policies=200
mean17923.497-17923.419=0.078
σ0.493-0.418=0.075
min17923.224-17923.106=0.118
max17924.236-17924.033=0.202
mean7600.000
σ0.000
min7600.000
max7600.000
mean2745.000-2753.000=-8.000
σ0.000
min2745.000-2753.000=-8.000
max2745.000-2753.000=-8.000
mean28.256-28.212=0.044
σ0.174-0.121=0.053
min28.010-28.108=-0.098
max28.420-28.385=0.035