Compare commits

Home / Compare 387b2971 .. 9268d688

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.868-70.867=0.001
σ0.047-0.045=0.002
min70.835-70.837=-0.002
max70.997-70.990=0.007
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.160-0.161=-0.001
σ0.003-0.004=-0.001
min0.157-0.157=0.000
max0.165-0.169=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.002-0.002=0.000
min21.487-21.489=-0.001
max21.496-21.496=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.063-0.061=0.002
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1716.175-1754.094=-37.919
σ169.609-0.362=169.247
min995.587-1753.533=-757.945
max1754.672-1754.689=-0.017
mean1635.900-1629.500=6.400
σ623.327-594.142=29.185
min627.000-639.000=-12.000
max2701.000-2421.000=280.000
mean2.737-2.764=-0.027
σ0.357-0.250=0.107
min1.436-2.148=-0.713
max3.012-3.164=-0.152

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.597-271.604=-0.007
σ0.009-0.005=0.003
min271.587-271.598=-0.011
max271.604-271.611=-0.007
mean2701.000-2421.000=280.000
σ0.000
min2701.000-2421.000=280.000
max2701.000-2421.000=280.000
mean0.382-0.386=-0.004
σ0.004-0.010=-0.005
min0.378-0.379=-0.001
max0.388-0.402=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.000-1931.999=0.001
σ0.009-0.009=0.000
min1931.988-1931.984=0.004
max1932.013-1932.007=0.005
mean2701.000-2421.000=280.000
σ0.000
min2701.000-2421.000=280.000
max2701.000-2421.000=280.000
mean2.595-2.537=0.058
σ0.198-0.123=0.075
min2.469-2.412=0.057
max2.933-2.700=0.233
iters=5
new-facts=6402
prior-facts=1
mean4752.515-4752.664=-0.149
σ1.129-0.935=0.194
min4751.266-4751.844=-0.578
max4754.360-4754.277=0.083
mean2701.000-2421.000=280.000
σ0.000
min2701.000-2421.000=280.000
max2701.000-2421.000=280.000
mean8.574-8.320=0.253
σ0.280-0.339=-0.059
min8.213-7.737=0.475
max8.992-8.538=0.454
iters=5
new-facts=6402
prior-facts=6402
mean4943.210-4943.068=0.142
σ0.012-0.301=-0.290
min4943.193-4942.529=0.664
max4943.221-4943.220=0.001
mean3035.800-2978.400=57.400
σ237.687-288.900=-51.213
min2701.000-2591.000=110.000
max3333.000-3321.000=12.000
mean8.587-8.588=-0.001
σ0.226-0.221=0.005
min8.365-8.379=-0.014
max8.906-8.911=-0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.792=-0.758
σ0.141-0.123=0.019
min0.938-1.595=-0.657
max1.263-1.898=-0.635

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean479.762-479.657=0.104
σ597.184-596.973=0.212
min181.158-181.166=-0.008
max1375.538-1375.116=0.422
mean88.250
σ8.500
min84.000
max101.000
mean2701.000-2421.000=280.000
σ0.000
min2701.000-2421.000=280.000
max2701.000-2421.000=280.000
mean0.577-0.561=0.016
σ0.584-0.549=0.035
min0.282-0.284=-0.002
max1.453-1.384=0.069
policies=20
mean1811.942-1811.957=-0.015
σ0.381-0.389=-0.008
min1811.677-1811.704=-0.027
max1812.503-1812.532=-0.029
mean840.000
σ0.000
min840.000
max840.000
mean2701.000-2421.000=280.000
σ0.000
min2701.000-2421.000=280.000
max2701.000-2421.000=280.000
mean2.850-2.842=0.008
σ0.032-0.011=0.021
min2.820-2.829=-0.009
max2.891-2.856=0.035
policies=200
mean18126.744-18126.653=0.091
σ0.523-0.512=0.011
min18126.315-18126.283=0.032
max18127.500-18127.397=0.103
mean8400.000
σ0.000
min8400.000
max8400.000
mean2701.000-2421.000=280.000
σ0.000
min2701.000-2421.000=280.000
max2701.000-2421.000=280.000
mean28.479-28.566=-0.087
σ0.079-0.078=0.002
min28.401-28.498=-0.097
max28.588-28.658=-0.070