Compare commits

Home / Compare 4f55ba62 .. 216cc304

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.701=0.002
σ0.046-0.046=-0.000
min70.674-70.667=0.007
max70.829-70.827=0.003
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.162-0.161=0.001
σ0.010-0.003=0.006
min0.150-0.158=-0.007
max0.181-0.167=0.014
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.000
σ0.003-0.002=0.001
min21.403-21.406=-0.004
max21.411-21.412=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.899-1754.898=0.001
σ0.362-0.361=0.001
min1754.337-1754.339=-0.002
max1755.483-1755.480=0.003
mean1632.150-1641.600=-9.450
σ608.059-619.645=-11.586
min632.000-633.000=-1.000
max2447.000-2483.000=-36.000
mean2.882-2.835=0.047
σ0.077-0.128=-0.050
min2.745-2.566=0.179
max3.020-3.015=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.740=0.019
σ0.002-0.010=-0.008
min272.755-272.728=0.027
max272.762-272.752=0.010
mean2447.000-2483.000=-36.000
σ0.000
min2447.000-2483.000=-36.000
max2447.000-2483.000=-36.000
mean0.387-0.393=-0.006
σ0.005-0.010=-0.005
min0.382-0.383=-0.001
max0.394-0.403=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1933.132-1933.129=0.004
σ0.015-0.015=0.000
min1933.114-1933.111=0.003
max1933.154-1933.145=0.009
mean2447.000-2483.000=-36.000
σ0.000
min2447.000-2483.000=-36.000
max2447.000-2483.000=-36.000
mean2.974-3.019=-0.045
σ0.132-0.177=-0.045
min2.753-2.778=-0.024
max3.086-3.243=-0.156
iters=5
new-facts=6402
prior-facts=1
mean4753.751-4753.746=0.005
σ1.024-1.023=0.002
min4752.845-4752.910=-0.064
max4755.518-4755.528=-0.010
mean2447.000-2483.000=-36.000
σ0.000
min2447.000-2483.000=-36.000
max2447.000-2483.000=-36.000
mean8.750-8.779=-0.029
σ0.281-0.261=0.020
min8.373-8.369=0.004
max9.024-9.097=-0.073
iters=5
new-facts=6402
prior-facts=6402
mean4944.361-4944.363=-0.001
σ0.014-0.016=-0.002
min4944.347-4944.344=0.002
max4944.378-4944.385=-0.007
mean2919.600-2922.800=-3.200
σ399.178-374.762=24.417
min2447.000-2483.000=-36.000
max3474.000-3425.000=49.000
mean8.387-8.398=-0.011
σ0.073-0.072=0.001
min8.311-8.312=-0.001
max8.496-8.502=-0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.846-1.710=0.136
σ0.076-0.092=-0.016
min1.787-1.623=0.164
max1.964-1.841=0.123

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.997-469.000=-0.004
σ575.613-575.618=-0.005
min181.187-181.189=-0.002
max1332.416-1332.427=-0.011
mean88.250
σ8.500
min84.000
max101.000
mean2447.000-2483.000=-36.000
σ0.000
min2447.000-2483.000=-36.000
max2447.000-2483.000=-36.000
mean0.569-0.564=0.005
σ0.552-0.547=0.005
min0.290-0.290=0.000
max1.396-1.384=0.012
policies=20
mean1812.212-1812.197=0.015
σ0.392-0.382=0.011
min1811.951-1811.956=-0.004
max1812.790-1812.761=0.029
mean840.000
σ0.000
min840.000
max840.000
mean2447.000-2483.000=-36.000
σ0.000
min2447.000-2483.000=-36.000
max2447.000-2483.000=-36.000
mean2.849-2.846=0.003
σ0.005-0.035=-0.031
min2.844-2.816=0.028
max2.854-2.897=-0.043
policies=200
mean18129.217-18129.232=-0.015
σ0.473-0.441=0.032
min18128.926-18128.922=0.004
max18129.921-18129.883=0.038
mean8400.000
σ0.000
min8400.000
max8400.000
mean2447.000-2483.000=-36.000
σ0.000
min2447.000-2483.000=-36.000
max2447.000-2483.000=-36.000
mean28.653-28.645=0.008
σ0.124-0.140=-0.016
min28.544-28.483=0.061
max28.829-28.807=0.022