Compare commits

Home / Compare 01818a0c .. a71a492c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=0.000
σ0.054-0.054=0.000
min35.588-35.591=-0.003
max35.772-35.771=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.085-0.086=-0.000
σ0.003-0.003=0.000
min0.082-0.083=-0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.001
σ0.004-0.003=0.000
min24.043-24.041=0.002
max24.053-24.051=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.067=-0.000
σ0.005-0.001=0.004
min0.062-0.065=-0.003
max0.075-0.068=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.493=-0.003
σ0.364-0.365=-0.001
min1755.914-1755.916=-0.002
max1757.076-1757.080=-0.004
mean1653.300-1626.100=27.200
σ646.932-592.413=54.519
min649.000-651.000=-2.000
max2844.000-2423.000=421.000
mean2.353-2.315=0.037
σ0.126-0.077=0.049
min2.155-2.231=-0.076
max2.714-2.493=0.221

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.768-324.775=-0.007
σ0.047-0.038=0.009
min324.685-324.707=-0.022
max324.801-324.798=0.004
mean2844.000-2423.000=421.000
σ0.000
min2844.000-2423.000=421.000
max2844.000-2423.000=421.000
mean0.423-0.429=-0.005
σ0.000-0.008=-0.008
min0.423-0.423=-0.000
max0.424-0.441=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.311=0.002
σ0.015-0.013=0.002
min1985.302-1985.299=0.003
max1985.331-1985.328=0.003
mean2844.000-2423.000=421.000
σ0.000
min2844.000-2423.000=421.000
max2844.000-2423.000=421.000
mean2.620-2.558=0.062
σ0.187-0.080=0.107
min2.373-2.477=-0.104
max2.835-2.665=0.170
iters=5
new-facts=6402
prior-facts=1
mean4809.084-4809.118=-0.034
σ7.685-7.637=0.049
min4805.629-4805.604=0.025
max4822.832-4822.777=0.055
mean2844.000-2423.000=421.000
σ0.000
min2844.000-2423.000=421.000
max2844.000-2423.000=421.000
mean8.926-8.745=0.182
σ0.119-0.532=-0.413
min8.727-7.986=0.741
max9.019-9.449=-0.430
iters=5
new-facts=6402
prior-facts=6402
mean4996.616-4996.631=-0.015
σ0.018-0.021=-0.003
min4996.595-4996.606=-0.011
max4996.643-4996.654=-0.011
mean3071.800-2900.600=171.200
σ302.521-403.860=-101.339
min2844.000-2423.000=421.000
max3541.000-3448.000=93.000
mean8.528-8.488=0.040
σ0.135-0.121=0.015
min8.410-8.421=-0.011
max8.724-8.703=0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-1.807=-0.823
σ0.137-0.045=0.092
min0.917-1.737=-0.820
max1.229-1.861=-0.632

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.211-463.199=0.012
σ574.775-574.759=0.016
min175.817-175.815=0.002
max1325.373-1325.337=0.036
mean86.250
σ8.500
min82.000
max99.000
mean2844.000-2423.000=421.000
σ0.000
min2844.000-2423.000=421.000
max2844.000-2423.000=421.000
mean0.428-0.548=-0.120
σ0.299-0.550=-0.250
min0.274-0.272=0.001
max0.877-1.372=-0.495
policies=20
mean1758.524-1758.498=0.026
σ0.345-0.355=-0.010
min1758.287-1758.264=0.024
max1759.035-1759.026=0.009
mean820.000
σ0.000
min820.000
max820.000
mean2844.000-2423.000=421.000
σ0.000
min2844.000-2423.000=421.000
max2844.000-2423.000=421.000
mean2.792-2.723=0.070
σ0.005-0.021=-0.016
min2.787-2.699=0.088
max2.798-2.750=0.048
policies=200
mean17592.145-17592.060=0.086
σ0.450-0.484=-0.034
min17591.899-17591.650=0.250
max17592.820-17592.761=0.059
mean8200.000
σ0.000
min8200.000
max8200.000
mean2844.000-2423.000=421.000
σ0.000
min2844.000-2423.000=421.000
max2844.000-2423.000=421.000
mean27.901-27.497=0.404
σ0.424-0.157=0.267
min27.436-27.327=0.109
max28.429-27.675=0.754