Compare commits

Home / Compare 718a4f80 .. 7ac71cb9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.107-0.108=-0.001
min35.749-35.745=0.004
max36.103-36.104=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.077-0.072=0.005
σ0.004-0.004=0.000
min0.073-0.068=0.005
max0.084-0.079=0.005
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.004=-0.001
min26.060-26.058=0.002
max26.067-26.069=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.060-0.059=0.002
σ0.003-0.001=0.002
min0.058-0.057=0.001
max0.068-0.060=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.923=0.001
σ0.364-0.368=-0.004
min1755.353-1755.350=0.004
max1756.527-1756.516=0.011
mean1661.850-1670.600=-8.750
σ627.479-639.543=-12.064
min609.000-669.000=-60.000
max2718.000-2700.000=18.000
mean2.856-2.872=-0.016
σ0.195-0.109=0.087
min2.330-2.574=-0.244
max3.128-3.020=0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-277.196=-0.003
σ0.006-0.005=0.000
min277.188-277.190=-0.001
max277.202-277.203=-0.001
mean2718.000-2700.000=18.000
σ0.000
min2718.000-2700.000=18.000
max2718.000-2700.000=18.000
mean0.394-0.399=-0.005
σ0.002-0.009=-0.007
min0.391-0.394=-0.003
max0.396-0.415=-0.019
iters=5
new-facts=1
prior-facts=6402
mean2174.424-2174.435=-0.011
σ0.013-0.018=-0.005
min2174.405-2174.414=-0.009
max2174.433-2174.464=-0.030
mean2718.000-2700.000=18.000
σ0.000
min2718.000-2700.000=18.000
max2718.000-2700.000=18.000
mean2.901-2.886=0.015
σ0.154-0.104=0.050
min2.773-2.786=-0.013
max3.085-3.047=0.038
iters=5
new-facts=6402
prior-facts=1
mean5052.593-5052.609=-0.016
σ0.988-1.003=-0.015
min5052.000-5052.046=-0.046
max5054.345-5054.391=-0.046
mean2718.000-2700.000=18.000
σ0.000
min2718.000-2700.000=18.000
max2718.000-2700.000=18.000
mean8.941-9.090=-0.149
σ0.586-0.697=-0.111
min8.073-8.034=0.039
max9.552-9.782=-0.230
iters=5
new-facts=6402
prior-facts=6402
mean5188.350-5188.397=-0.046
σ0.127-0.125=0.002
min5188.164-5188.229=-0.065
max5188.523-5188.528=-0.006
mean3225.400-3220.000=5.400
σ461.621-459.772=1.849
min2718.000-2700.000=18.000
max3863.000-3847.000=16.000
mean8.729-8.791=-0.062
σ0.115-0.160=-0.045
min8.666-8.645=0.021
max8.935-9.056=-0.121

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.085-1.184=-0.099
σ0.109-0.133=-0.024
min0.941-1.012=-0.071
max1.246-1.334=-0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-464.854=0.002
σ572.656-572.657=-0.001
min178.518-178.521=-0.003
max1323.839-1323.839=-0.000
mean79.500
σ7.000
min76.000
max90.000
mean2718.000-2700.000=18.000
σ0.000
min2718.000-2700.000=18.000
max2718.000-2700.000=18.000
mean0.545-0.563=-0.018
σ0.519-0.563=-0.045
min0.282-0.280=0.002
max1.323-1.408=-0.085
policies=20
mean1785.460-1785.490=-0.030
σ0.342-0.343=-0.001
min1785.230-1785.265=-0.035
max1785.968-1785.998=-0.031
mean760.000
σ0.000
min760.000
max760.000
mean2718.000-2700.000=18.000
σ0.000
min2718.000-2700.000=18.000
max2718.000-2700.000=18.000
mean2.798-2.811=-0.013
σ0.014-0.011=0.003
min2.782-2.798=-0.015
max2.816-2.823=-0.007
policies=200
mean17861.444-17861.397=0.047
σ0.422-0.567=-0.145
min17861.112-17861.028=0.084
max17862.059-17862.228=-0.169
mean7600.000
σ0.000
min7600.000
max7600.000
mean2718.000-2700.000=18.000
σ0.000
min2718.000-2700.000=18.000
max2718.000-2700.000=18.000
mean28.242-28.257=-0.015
σ0.212-0.143=0.069
min27.990-28.118=-0.128
max28.458-28.384=0.074