Compare commits

Home / Compare 3880ce2d .. 677dae55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.039=0.001
σ0.050-0.049=0.001
min31.001-31.002=-0.002
max31.178-31.174=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.079-0.077=0.002
σ0.003-0.005=-0.002
min0.077-0.071=0.006
max0.086-0.086=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.003-0.002=0.001
min21.139-21.138=0.001
max21.146-21.146=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.064=-0.000
σ0.003-0.001=0.002
min0.059-0.063=-0.004
max0.069-0.065=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.409=0.001
σ0.360-0.361=-0.001
min1750.847-1750.850=-0.003
max1751.993-1751.999=-0.006
mean1663.000-1661.300=1.700
σ625.180-624.122=1.058
min637.000-659.000=-22.000
max2514.000-2509.000=5.000
mean2.811-2.805=0.006
σ0.115-0.115=0.001
min2.591-2.597=-0.006
max3.053-3.047=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.402-273.404=-0.002
σ0.012-0.010=0.002
min273.391-273.394=-0.003
max273.416-273.417=-0.001
mean2514.000-2509.000=5.000
σ0.000
min2514.000-2509.000=5.000
max2514.000-2509.000=5.000
mean0.384-0.386=-0.002
σ0.008-0.011=-0.003
min0.379-0.378=0.002
max0.399-0.399=0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.832-1933.839=-0.007
σ0.012-0.003=0.009
min1933.823-1933.835=-0.012
max1933.852-1933.843=0.009
mean2514.000-2509.000=5.000
σ0.000
min2514.000-2509.000=5.000
max2514.000-2509.000=5.000
mean3.052-3.081=-0.029
σ0.113-0.178=-0.065
min2.885-2.902=-0.017
max3.187-3.370=-0.183
iters=5
new-facts=6402
prior-facts=1
mean4754.401-4754.309=0.092
σ0.805-0.884=-0.079
min4753.955-4753.788=0.167
max4755.833-4755.884=-0.050
mean2514.000-2509.000=5.000
σ0.000
min2514.000-2509.000=5.000
max2514.000-2509.000=5.000
mean8.052-8.659=-0.607
σ0.405-0.608=-0.203
min7.701-7.727=-0.025
max8.682-9.166=-0.484
iters=5
new-facts=6402
prior-facts=6402
mean4944.799-4944.796=0.003
σ0.087-0.081=0.005
min4944.729-4944.723=0.006
max4944.894-4944.897=-0.003
mean2921.000-2941.000=-20.000
σ377.332-385.456=-8.124
min2514.000-2509.000=5.000
max3437.000-3433.000=4.000
mean8.462-8.571=-0.109
σ0.123-0.304=-0.180
min8.374-8.374=-0.001
max8.677-9.105=-0.429

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.720-1.766=-0.046
σ0.173-0.155=0.018
min1.424-1.531=-0.107
max1.862-1.913=-0.051

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.335-463.328=0.007
σ572.197-572.196=0.001
min177.234-177.226=0.007
max1321.630-1321.622=0.008
mean79.750
σ7.500
min76.000
max91.000
mean2514.000-2509.000=5.000
σ0.000
min2514.000-2509.000=5.000
max2514.000-2509.000=5.000
mean0.551-0.554=-0.002
σ0.543-0.541=0.002
min0.276-0.276=-0.000
max1.365-1.364=0.001
policies=20
mean1772.575-1772.568=0.008
σ0.342-0.336=0.007
min1772.356-1772.346=0.010
max1773.085-1773.066=0.018
mean760.000
σ0.000
min760.000
max760.000
mean2514.000-2509.000=5.000
σ0.000
min2514.000-2509.000=5.000
max2514.000-2509.000=5.000
mean2.776-2.754=0.022
σ0.029-0.009=0.020
min2.735-2.744=-0.009
max2.804-2.766=0.037
policies=200
mean17732.400-17732.261=0.138
σ0.421-0.511=-0.090
min17732.066-17731.973=0.093
max17733.015-17733.024=-0.009
mean7600.000
σ0.000
min7600.000
max7600.000
mean2514.000-2509.000=5.000
σ0.000
min2514.000-2509.000=5.000
max2514.000-2509.000=5.000
mean27.758-27.737=0.022
σ0.081-0.109=-0.028
min27.655-27.610=0.045
max27.832-27.876=-0.044