Compare commits

Home / Compare 1aab2763 .. b9754f93

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=0.001
σ0.105-0.108=-0.003
min35.753-35.751=0.001
max36.098-36.104=-0.007
mean415.000-414.300=0.700
σ0.000-0.483=-0.483
min415.000-414.000=1.000
max415.000
mean0.076-0.077=-0.000
σ0.004-0.004=-0.000
min0.073-0.074=-0.001
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.004-0.003=0.001
min26.058-26.060=-0.002
max26.070-26.071=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.060-0.062=-0.003
σ0.003-0.003=0.001
min0.057-0.060=-0.004
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.922=0.001
σ0.366-0.366=0.000
min1755.351-1755.345=0.005
max1756.513-1756.494=0.019
mean1667.150-1671.250=-4.100
σ626.377-629.737=-3.359
min667.000-668.000=-1.000
max2613.000-2625.000=-12.000
mean2.784-2.762=0.022
σ0.151-0.185=-0.033
min2.527-2.276=0.251
max2.991-3.085=-0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195-277.202=-0.007
σ0.006-0.008=-0.002
min277.187-277.190=-0.003
max277.202-277.208=-0.006
mean2613.000-2625.000=-12.000
σ0.000
min2613.000-2625.000=-12.000
max2613.000-2625.000=-12.000
mean0.396-0.416=-0.019
σ0.007-0.015=-0.008
min0.391-0.403=-0.012
max0.408-0.436=-0.029
iters=5
new-facts=1
prior-facts=6402
mean2174.411-2174.428=-0.017
σ0.016-0.016=0.000
min2174.392-2174.404=-0.011
max2174.429-2174.447=-0.018
mean2613.000-2625.000=-12.000
σ0.000
min2613.000-2625.000=-12.000
max2613.000-2625.000=-12.000
mean2.862-2.886=-0.024
σ0.127-0.095=0.032
min2.755-2.786=-0.031
max3.024-3.005=0.018
iters=5
new-facts=6402
prior-facts=1
mean5052.620-5052.478=0.142
σ0.943-0.713=0.231
min5052.029-5052.091=-0.062
max5054.296-5053.750=0.546
mean2613.000-2625.000=-12.000
σ0.000
min2613.000-2625.000=-12.000
max2613.000-2625.000=-12.000
mean8.871-8.754=0.117
σ0.634-0.470=0.164
min8.017-8.215=-0.199
max9.625-9.424=0.201
iters=5
new-facts=6402
prior-facts=6402
mean5188.421-5188.422=-0.001
σ0.090-0.094=-0.005
min5188.352-5188.330=0.022
max5188.524-5188.527=-0.003
mean3204.400-3209.800=-5.400
σ492.953-480.692=12.261
min2613.000-2625.000=-12.000
max3864.000-3855.000=9.000
mean8.737-8.891=-0.154
σ0.160-0.447=-0.286
min8.605-8.568=0.037
max9.016-9.647=-0.630

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.253-1.319=-0.066
σ0.327-0.328=-0.001
min0.941-0.950=-0.009
max1.797-1.722=0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.854-464.857=-0.003
σ572.660-572.661=-0.001
min178.520-178.522=-0.002
max1323.844-1323.848=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean2613.000-2625.000=-12.000
σ0.000
min2613.000-2625.000=-12.000
max2613.000-2625.000=-12.000
mean0.548-0.568=-0.020
σ0.519-0.562=-0.044
min0.280-0.279=0.001
max1.326-1.411=-0.085
policies=20
mean1785.481-1785.483=-0.002
σ0.355-0.357=-0.003
min1785.241-1785.252=-0.012
max1786.007-1786.014=-0.007
mean760.000
σ0.000
min760.000
max760.000
mean2613.000-2625.000=-12.000
σ0.000
min2613.000-2625.000=-12.000
max2613.000-2625.000=-12.000
mean2.782-2.772=0.010
σ0.016-0.022=-0.005
min2.760-2.750=0.010
max2.799-2.802=-0.003
policies=200
mean17861.441-17861.411=0.030
σ0.493-0.596=-0.103
min17861.108-17861.088=0.020
max17862.170-17862.305=-0.135
mean7600.000
σ0.000
min7600.000
max7600.000
mean2613.000-2625.000=-12.000
σ0.000
min2613.000-2625.000=-12.000
max2613.000-2625.000=-12.000
mean28.182-28.117=0.065
σ0.233-0.173=0.060
min27.916-27.949=-0.033
max28.467-28.313=0.154