Compare commits

Home / Compare dad2c7ce .. 4ee55bfd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-35.793=0.001
σ0.108-0.107=0.001
min35.740-35.742=-0.002
max36.099-36.097=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.076-0.076=0.000
σ0.004-0.004=-0.000
min0.073-0.073=0.000
max0.083-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.064=-0.000
σ0.004-0.004=0.001
min26.056-26.058=-0.002
max26.069-26.068=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.060-0.058=0.001
σ0.003-0.003=0.000
min0.056-0.056=0.000
max0.068-0.065=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.107-1756.106=0.000
σ0.366-0.364=0.002
min1755.537-1755.536=0.001
max1756.698-1756.696=0.002
mean1657.800-1667.600=-9.800
σ631.468-630.699=0.769
min668.000
max2608.000-2615.000=-7.000
mean2.794-2.807=-0.012
σ0.216-0.143=0.074
min2.211-2.411=-0.200
max3.153-2.963=0.190

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.387-277.387=-0.000
σ0.005-0.005=-0.001
min277.380-277.383=-0.003
max277.392-277.396=-0.004
mean2608.000-2615.000=-7.000
σ0.000
min2608.000-2615.000=-7.000
max2608.000-2615.000=-7.000
mean0.396-0.394=0.001
σ0.007-0.001=0.007
min0.392-0.393=-0.001
max0.408-0.395=0.014
iters=5
new-facts=1
prior-facts=6402
mean2174.629-2174.634=-0.005
σ0.025-0.012=0.013
min2174.606-2174.624=-0.017
max2174.672-2174.650=0.022
mean2608.000-2615.000=-7.000
σ0.000
min2608.000-2615.000=-7.000
max2608.000-2615.000=-7.000
mean2.851-2.972=-0.122
σ0.170-0.147=0.023
min2.760-2.754=0.006
max3.154-3.158=-0.004
iters=5
new-facts=6402
prior-facts=1
mean5052.588-5052.673=-0.086
σ0.417-1.083=-0.666
min5052.300-5051.691=0.609
max5053.316-5054.530=-1.214
mean2608.000-2615.000=-7.000
σ0.000
min2608.000-2615.000=-7.000
max2608.000-2615.000=-7.000
mean8.571-9.209=-0.638
σ0.633-0.388=0.245
min8.041-8.820=-0.778
max9.636-9.692=-0.056
iters=5
new-facts=6402
prior-facts=6402
mean5188.608-5188.552=0.056
σ0.091-0.211=-0.120
min5188.533-5188.201=0.332
max5188.712-5188.720=-0.008
mean3226.800-3221.600=5.200
σ536.736-380.772=155.964
min2608.000-2685.000=-77.000
max3984.000-3695.000=289.000
mean8.757-8.914=-0.157
σ0.221-0.285=-0.064
min8.609-8.693=-0.083
max9.147-9.382=-0.235

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.333-1.399=-0.065
σ0.416-0.443=-0.027
min0.940-0.947=-0.006
max1.833-2.033=-0.200

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.225-465.220=0.005
σ572.662-572.652=0.010
min178.891-178.893=-0.001
max1324.219-1324.198=0.021
mean81.750
σ7.500
min78.000
max93.000
mean2608.000-2615.000=-7.000
σ0.000
min2608.000-2615.000=-7.000
max2608.000-2615.000=-7.000
mean0.542-0.566=-0.024
σ0.519-0.569=-0.051
min0.280-0.280=-0.001
max1.320-1.420=-0.100
policies=20
mean1789.147-1789.150=-0.002
σ0.365-0.372=-0.007
min1788.936-1788.932=0.004
max1789.692-1789.704=-0.012
mean780.000
σ0.000
min780.000
max780.000
mean2608.000-2615.000=-7.000
σ0.000
min2608.000-2615.000=-7.000
max2608.000-2615.000=-7.000
mean2.800-2.802=-0.002
σ0.021-0.010=0.011
min2.772-2.793=-0.021
max2.821-2.816=0.005
policies=200
mean17898.246-17898.271=-0.025
σ0.405-0.515=-0.110
min17898.017-17897.977=0.040
max17898.852-17899.040=-0.188
mean7800.000
σ0.000
min7800.000
max7800.000
mean2608.000-2615.000=-7.000
σ0.000
min2608.000-2615.000=-7.000
max2608.000-2615.000=-7.000
mean28.324-28.409=-0.085
σ0.095-0.153=-0.058
min28.192-28.279=-0.087
max28.417-28.584=-0.167