Compare commits

Home / Compare af11d887 .. d4338c92

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.050-0.047=0.004
min33.945-33.953=-0.008
max34.116-34.108=0.009
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.084-0.082=0.001
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.089-0.090=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.000
σ0.003-0.003=0.000
min23.314-23.314=0.001
max23.324-23.322=0.002
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.066-0.065=0.001
σ0.003-0.002=0.001
min0.064-0.064=0.000
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.301=0.002
σ0.365-0.365=0.000
min1756.729-1756.729=-0.000
max1757.893-1757.896=-0.003
mean1647.800-1641.300=6.500
σ624.132-624.851=-0.719
min637.000-631.000=6.000
max2826.000
mean2.355-2.330=0.025
σ0.096-0.055=0.041
min2.258-2.262=-0.005
max2.622-2.428=0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.458-326.443=0.014
σ0.031-0.058=-0.027
min326.405-326.340=0.064
max326.484-326.475=0.009
mean2826.000
σ0.000
min2826.000
max2826.000
mean0.427-0.426=0.001
σ0.005-0.007=-0.002
min0.422-0.422=0.000
max0.433-0.438=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1988.612-1988.619=-0.007
σ0.011-0.003=0.007
min1988.598-1988.616=-0.018
max1988.622-1988.623=-0.001
mean2826.000
σ0.000
min2826.000
max2826.000
mean2.716-2.709=0.006
σ0.134-0.116=0.018
min2.605-2.633=-0.028
max2.949-2.912=0.037
iters=5
new-facts=6402
prior-facts=1
mean4813.478-4813.488=-0.010
σ7.725-7.699=0.026
min4809.910-4809.903=0.007
max4827.295-4827.259=0.036
mean2826.000
σ0.000
min2826.000
max2826.000
mean8.564-8.316=0.248
σ0.597-0.514=0.083
min7.694-7.824=-0.130
max9.231-9.111=0.120
iters=5
new-facts=6402
prior-facts=6402
mean5001.009-5001.008=0.000
σ0.016-0.026=-0.010
min5000.988-5000.975=0.013
max5001.024-5001.042=-0.018
mean2998.600-3052.200=-53.600
σ246.930-298.592=-51.662
min2826.000
max3399.000-3510.000=-111.000
mean9.732-9.690=0.041
σ0.045-0.268=-0.223
min9.659-9.228=0.431
max9.782-9.913=-0.131

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-0.972=0.026
σ0.064-0.065=-0.000
min0.916-0.920=-0.004
max1.052-1.045=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.444-464.441=0.003
σ574.770-574.771=-0.001
min177.045-177.046=-0.001
max1326.599-1326.598=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2826.000
σ0.000
min2826.000
max2826.000
mean0.438-0.437=0.001
σ0.307-0.305=0.002
min0.283-0.282=0.001
max0.899-0.895=0.004
policies=20
mean1770.804-1770.801=0.003
σ0.353-0.366=-0.013
min1770.554-1770.550=0.004
max1771.324-1771.343=-0.019
mean840.000
σ0.000
min840.000
max840.000
mean2826.000
σ0.000
min2826.000
max2826.000
mean2.816-2.805=0.011
σ0.020-0.024=-0.004
min2.798-2.779=0.018
max2.843-2.837=0.006
policies=200
mean17714.871-17714.848=0.023
σ0.538-0.517=0.021
min17714.500-17714.420=0.080
max17715.671-17715.596=0.075
mean8400.000
σ0.000
min8400.000
max8400.000
mean2826.000
σ0.000
min2826.000
max2826.000
mean27.919-27.892=0.027
σ0.370-0.377=-0.007
min27.604-27.583=0.021
max28.335-28.366=-0.031