Compare commits

Home / Compare 2080b659 .. 3db111de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.108-0.106=0.002
min35.749-35.752=-0.003
max36.105-36.100=0.005
mean411.000-413.800=-2.800
σ0.000-0.422=-0.422
min411.000-413.000=-2.000
max411.000-414.000=-3.000
mean0.077-0.075=0.002
σ0.004-0.004=-0.000
min0.074-0.070=0.004
max0.083-0.082=0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=0.000
σ0.002-0.002=-0.000
min26.061-26.061=0.001
max26.069-26.067=0.002
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.060-0.059=0.001
σ0.003-0.003=0.001
min0.057-0.056=0.000
max0.068-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.922=0.002
σ0.367-0.368=-0.001
min1755.352-1755.351=0.001
max1756.510-1756.520=-0.010
mean1672.900-1668.500=4.400
σ644.206-631.399=12.807
min668.000
max2711.000-2618.000=93.000
mean2.813-2.822=-0.010
σ0.151-0.128=0.023
min2.367-2.473=-0.107
max2.987-2.997=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.195=-0.001
σ0.007-0.007=0.001
min277.186-277.188=-0.002
max277.201-277.204=-0.003
mean2711.000-2618.000=93.000
σ0.000
min2711.000-2618.000=93.000
max2711.000-2618.000=93.000
mean0.404-0.396=0.008
σ0.006-0.008=-0.001
min0.400-0.391=0.008
max0.415-0.409=0.006
iters=5
new-facts=1
prior-facts=6402
mean2174.445-2174.454=-0.009
σ0.018-0.023=-0.005
min2174.427-2174.427=0.000
max2174.475-2174.473=0.002
mean2711.000-2618.000=93.000
σ0.000
min2711.000-2618.000=93.000
max2711.000-2618.000=93.000
mean2.966-2.862=0.103
σ0.145-0.098=0.047
min2.749-2.789=-0.039
max3.100-3.004=0.096
iters=5
new-facts=6402
prior-facts=1
mean5052.443-5052.610=-0.167
σ1.048-0.967=0.080
min5051.421-5052.054=-0.633
max5054.214-5054.331=-0.117
mean2711.000-2618.000=93.000
σ0.000
min2711.000-2618.000=93.000
max2711.000-2618.000=93.000
mean8.768-8.980=-0.213
σ0.391-0.650=-0.259
min8.090-8.055=0.036
max9.099-9.631=-0.532
iters=5
new-facts=6402
prior-facts=6402
mean5188.355-5188.354=0.001
σ0.127-0.206=-0.079
min5188.168-5188.019=0.148
max5188.524-5188.528=-0.004
mean3227.200-3210.000=17.200
σ379.504-491.972=-112.468
min2711.000-2618.000=93.000
max3710.000-3867.000=-157.000
mean8.965-8.690=0.275
σ0.408-0.176=0.232
min8.658-8.522=0.136
max9.645-8.983=0.662

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.280=-0.203
σ0.185-0.276=-0.091
min0.940-0.948=-0.007
max1.308-1.571=-0.263

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.858=-0.001
σ572.661-572.659=0.003
min178.519-178.525=-0.005
max1323.849-1323.846=0.003
mean79.500
σ7.000
min76.000
max90.000
mean2711.000-2618.000=93.000
σ0.000
min2711.000-2618.000=93.000
max2711.000-2618.000=93.000
mean0.569-0.557=0.011
σ0.556-0.552=0.004
min0.280-0.277=0.003
max1.403-1.385=0.018
policies=20
mean1785.481-1785.488=-0.007
σ0.342-0.354=-0.013
min1785.253-1785.259=-0.006
max1785.989-1786.015=-0.027
mean760.000
σ0.000
min760.000
max760.000
mean2711.000-2618.000=93.000
σ0.000
min2711.000-2618.000=93.000
max2711.000-2618.000=93.000
mean2.786-2.792=-0.006
σ0.015-0.022=-0.006
min2.770-2.764=0.006
max2.802-2.814=-0.011
policies=200
mean17861.561-17861.555=0.006
σ0.511-0.516=-0.005
min17861.283-17861.249=0.034
max17862.327-17862.326=0.001
mean7600.000
σ0.000
min7600.000
max7600.000
mean2711.000-2618.000=93.000
σ0.000
min2711.000-2618.000=93.000
max2711.000-2618.000=93.000
mean28.195-28.220=-0.025
σ0.128-0.174=-0.046
min28.073-28.043=0.030
max28.320-28.454=-0.134