Compare commits

Home / Compare 5396e844 .. 42f9230b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.045-0.049=-0.003
min33.952-33.947=0.005
max34.104-34.113=-0.010
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.084-0.084=0.001
σ0.004-0.003=0.000
min0.081-0.078=0.004
max0.091-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.318-23.316=0.002
σ0.002-0.002=0.000
min23.315-23.313=0.002
max23.323-23.319=0.003
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.065-0.064=0.001
σ0.003-0.003=-0.001
min0.064-0.059=0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.427=0.000
σ0.364-0.363=0.001
min1756.856-1756.854=0.002
max1758.020-1758.016=0.004
mean1677.800-1668.850=8.950
σ636.007-622.532=13.476
min665.000-679.000=-14.000
max2646.000-2639.000=7.000
mean2.376-2.391=-0.015
σ0.120-0.144=-0.024
min2.234-2.262=-0.028
max2.750-2.799=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.577-326.578=-0.001
σ0.037-0.032=0.005
min326.512-326.522=-0.009
max326.600-326.598=0.001
mean2646.000-2639.000=7.000
σ0.000
min2646.000-2639.000=7.000
max2646.000-2639.000=7.000
mean0.425-0.423=0.003
σ0.002-0.001=0.001
min0.422-0.421=0.001
max0.427-0.424=0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.724-1988.734=-0.009
σ0.023-0.006=0.017
min1988.694-1988.727=-0.034
max1988.748-1988.743=0.005
mean2646.000-2639.000=7.000
σ0.000
min2646.000-2639.000=7.000
max2646.000-2639.000=7.000
mean2.777-2.756=0.021
σ0.120-0.101=0.020
min2.618-2.611=0.007
max2.910-2.856=0.053
iters=5
new-facts=6402
prior-facts=1
mean4672.733-4813.614=-140.881
σ316.453-7.738=308.715
min4106.794-4810.043=-703.248
max4826.852-4827.456=-0.604
mean2646.000-2639.000=7.000
σ0.000
min2646.000-2639.000=7.000
max2646.000-2639.000=7.000
mean8.349-8.527=-0.178
σ0.856-0.537=0.319
min7.063-7.971=-0.908
max9.189-9.361=-0.171
iters=5
new-facts=6402
prior-facts=6402
mean5001.092-5001.137=-0.045
σ0.159-0.023=0.136
min5000.811-5001.114=-0.303
max5001.203-5001.164=0.039
mean3016.000-2964.200=51.800
σ369.123-337.886=31.237
min2646.000-2639.000=7.000
max3503.000-3448.000=55.000
mean10.191-9.713=0.478
σ0.274-0.128=0.145
min9.946-9.498=0.448
max10.620-9.804=0.816

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.110=0.027
σ0.311-0.239=0.072
min0.907-0.899=0.008
max1.670-1.462=0.208

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.568-464.566=0.001
σ574.776-574.778=-0.002
min177.172-177.171=0.000
max1326.732-1326.733=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2646.000-2639.000=7.000
σ0.000
min2646.000-2639.000=7.000
max2646.000-2639.000=7.000
mean0.528-0.543=-0.015
σ0.509-0.541=-0.031
min0.271-0.263=0.008
max1.292-1.354=-0.062
policies=20
mean1772.050-1772.029=0.021
σ0.354-0.345=0.010
min1771.813-1771.804=0.009
max1772.575-1772.542=0.033
mean840.000
σ0.000
min840.000
max840.000
mean2646.000-2639.000=7.000
σ0.000
min2646.000-2639.000=7.000
max2646.000-2639.000=7.000
mean2.734-2.724=0.010
σ0.013-0.029=-0.015
min2.722-2.697=0.025
max2.753-2.757=-0.004
policies=200
mean17727.611-17727.588=0.023
σ0.472-0.537=-0.065
min17727.356-17727.293=0.063
max17728.318-17728.392=-0.074
mean8400.000
σ0.000
min8400.000
max8400.000
mean2646.000-2639.000=7.000
σ0.000
min2646.000-2639.000=7.000
max2646.000-2639.000=7.000
mean27.481-27.536=-0.055
σ0.166-0.119=0.047
min27.335-27.407=-0.072
max27.636-27.642=-0.007