Compare commits

Home / Compare 953e62b7 .. a58d6028

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.000
σ0.107-0.107=-0.001
min35.753-35.751=0.002
max36.101-36.102=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.074-0.075=-0.001
σ0.005-0.005=-0.000
min0.069-0.068=0.001
max0.082-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=0.001
σ0.003-0.003=0.000
min26.058-26.060=-0.002
max26.068-26.068=-0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.061-0.058=0.003
σ0.003-0.002=0.001
min0.059-0.056=0.003
max0.070-0.064=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.919=0.002
σ0.366-0.369=-0.003
min1755.343-1755.347=-0.004
max1756.511-1756.513=-0.002
mean1668.400-1665.700=2.700
σ629.585-627.719=1.866
min671.000-672.000=-1.000
max2660.000-2656.000=4.000
mean2.837-2.788=0.049
σ0.117-0.129=-0.012
min2.623-2.523=0.099
max3.086-2.956=0.130

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-277.197=-0.001
σ0.005-0.007=-0.002
min277.189-277.189=0.000
max277.203-277.206=-0.002
mean2660.000-2656.000=4.000
σ0.000
min2660.000-2656.000=4.000
max2660.000-2656.000=4.000
mean0.398-0.394=0.004
σ0.008-0.006=0.002
min0.394-0.390=0.004
max0.412-0.405=0.007
iters=5
new-facts=1
prior-facts=6402
mean2174.438-2174.442=-0.004
σ0.024-0.011=0.012
min2174.414-2174.424=-0.011
max2174.465-2174.452=0.013
mean2660.000-2656.000=4.000
σ0.000
min2660.000-2656.000=4.000
max2660.000-2656.000=4.000
mean2.952-2.944=0.008
σ0.139-0.119=0.020
min2.774-2.778=-0.003
max3.123-3.070=0.053
iters=5
new-facts=6402
prior-facts=1
mean5052.625-5052.638=-0.012
σ0.976-0.990=-0.014
min5051.998-5052.034=-0.035
max5054.356-5054.396=-0.040
mean2660.000-2656.000=4.000
σ0.000
min2660.000-2656.000=4.000
max2660.000-2656.000=4.000
mean8.673-8.714=-0.042
σ0.599-0.644=-0.045
min8.120-8.251=-0.130
max9.518-9.743=-0.225
iters=5
new-facts=6402
prior-facts=6402
mean5188.431-5188.426=0.005
σ0.083-0.093=-0.010
min5188.363-5188.348=0.015
max5188.522-5188.532=-0.010
mean3231.400-3230.400=1.000
σ366.155-393.577=-27.422
min2702.000-2693.000=9.000
max3688.000-3730.000=-42.000
mean8.981-8.928=0.053
σ0.315-0.411=-0.096
min8.707-8.633=0.074
max9.367-9.634=-0.267

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.115-1.141=-0.026
σ0.180-0.314=-0.134
min0.949-0.937=0.012
max1.346-1.653=-0.306

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.862-464.859=0.003
σ572.658-572.671=-0.014
min178.522-178.522=-0.000
max1323.848-1323.865=-0.017
mean79.500
σ7.000
min76.000
max90.000
mean2660.000-2656.000=4.000
σ0.000
min2660.000-2656.000=4.000
max2660.000-2656.000=4.000
mean0.556-0.554=0.002
σ0.548-0.535=0.013
min0.281-0.281=-0.000
max1.378-1.356=0.021
policies=20
mean1785.492-1785.474=0.018
σ0.354-0.360=-0.005
min1785.260-1785.239=0.021
max1786.018-1786.009=0.009
mean760.000
σ0.000
min760.000
max760.000
mean2660.000-2656.000=4.000
σ0.000
min2660.000-2656.000=4.000
max2660.000-2656.000=4.000
mean2.807-2.790=0.018
σ0.011-0.011=-0.000
min2.797-2.777=0.020
max2.820-2.803=0.016
policies=200
mean17861.537-17861.549=-0.013
σ0.466-0.489=-0.022
min17861.295-17861.240=0.054
max17862.236-17862.279=-0.043
mean7600.000
σ0.000
min7600.000
max7600.000
mean2660.000-2656.000=4.000
σ0.000
min2660.000-2656.000=4.000
max2660.000-2656.000=4.000
mean28.318-28.193=0.124
σ0.178-0.081=0.097
min28.174-28.118=0.056
max28.548-28.301=0.248