Compare commits

Home / Compare 2e708f2f .. ba27de2c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=-0.000
σ0.048-0.049=-0.001
min30.998-31.002=-0.003
max31.173-31.176=-0.003
mean414.800-414.000=0.800
σ0.422-0.000=0.422
min414.000
max415.000-414.000=1.000
mean0.079-0.073=0.006
σ0.003-0.004=-0.001
min0.076-0.070=0.006
max0.085-0.081=0.004
cache=y
dps=1
iters=10
policies=100
mean21.142-21.144=-0.002
σ0.002-0.003=-0.000
min21.138-21.141=-0.004
max21.144-21.148=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.060-0.063=-0.003
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.412=-0.001
σ0.361-0.360=0.001
min1750.844-1750.853=-0.009
max1751.995-1751.976=0.020
mean1658.750-1660.600=-1.850
σ622.925-621.270=1.655
min659.000-639.000=20.000
max2505.000
mean2.775-2.831=-0.056
σ0.236-0.191=0.045
min2.286-2.293=-0.007
max3.048-3.210=-0.162

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-273.397=0.008
σ0.014-0.018=-0.004
min273.392-273.367=0.025
max273.420-273.412=0.008
mean2505.000
σ0.000
min2505.000
max2505.000
mean0.385-0.384=0.001
σ0.010-0.009=0.001
min0.377-0.377=0.001
max0.398-0.394=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.834-1933.834=-0.001
σ0.011-0.004=0.007
min1933.820-1933.831=-0.010
max1933.848-1933.841=0.006
mean2505.000
σ0.000
min2505.000
max2505.000
mean3.102-3.030=0.073
σ0.161-0.109=0.051
min2.990-2.876=0.114
max3.377-3.165=0.212
iters=5
new-facts=6402
prior-facts=1
mean4754.408-4754.292=0.116
σ0.813-0.879=-0.066
min4753.985-4753.614=0.372
max4755.855-4755.835=0.020
mean2505.000
σ0.000
min2505.000
max2505.000
mean8.052-8.069=-0.017
σ0.432-0.382=0.050
min7.734-7.740=-0.006
max8.807-8.707=0.100
iters=5
new-facts=6402
prior-facts=6402
mean4944.795-4944.727=0.069
σ0.085-0.199=-0.114
min4944.729-4944.391=0.338
max4944.893-4944.876=0.016
mean2925.200-2962.200=-37.000
σ390.585-412.198=-21.613
min2505.000
max3449.000-3523.000=-74.000
mean8.470-8.625=-0.155
σ0.099-0.461=-0.362
min8.351-8.393=-0.042
max8.624-9.449=-0.824

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.728-1.732=-0.004
σ0.158-0.066=0.092
min1.452-1.639=-0.187
max1.828-1.801=0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.333=0.000
σ572.198-572.193=0.005
min177.233-177.235=-0.002
max1321.630-1321.623=0.007
mean79.750
σ7.500
min76.000
max91.000
mean2505.000
σ0.000
min2505.000
max2505.000
mean0.561-0.540=0.022
σ0.576-0.519=0.057
min0.269-0.272=-0.003
max1.426-1.319=0.107
policies=20
mean1772.586-1772.587=-0.001
σ0.341-0.337=0.004
min1772.366-1772.366=0.000
max1773.093-1773.087=0.006
mean760.000
σ0.000
min760.000
max760.000
mean2505.000
σ0.000
min2505.000
max2505.000
mean2.752-2.741=0.011
σ0.016-0.001=0.015
min2.732-2.739=-0.008
max2.771-2.742=0.028
policies=200
mean17732.392-17732.364=0.028
σ0.573-0.596=-0.023
min17731.937-17731.993=-0.056
max17733.215-17733.247=-0.032
mean7600.000
σ0.000
min7600.000
max7600.000
mean2505.000
σ0.000
min2505.000
max2505.000
mean27.720-27.666=0.055
σ0.135-0.154=-0.019
min27.604-27.521=0.083
max27.880-27.878=0.001