Compare commits

Home / Compare c207691d .. 3d1eb078

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.562=0.003
σ0.046-0.046=0.000
min70.540-70.539=0.000
max70.691-70.690=0.001
mean413.000-413.400=-0.400
σ0.000-0.516=-0.516
min413.000
max413.000-414.000=-1.000
mean0.158-0.156=0.002
σ0.004-0.005=-0.002
min0.151-0.148=0.003
max0.163-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.000
σ0.003-0.003=0.001
min21.281-21.283=-0.002
max21.292-21.292=-0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.060-0.063=-0.003
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.376=-0.002
σ0.360-0.361=-0.001
min1752.801-1752.802=-0.000
max1753.956-1753.972=-0.016
mean1650.400-1654.700=-4.300
σ639.040-644.530=-5.490
min627.000-632.000=-5.000
max2845.000-2888.000=-43.000
mean2.773-2.827=-0.055
σ0.210-0.141=0.070
min2.253-2.484=-0.230
max2.982-3.092=-0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.759=-0.006
σ0.006-0.005=0.001
min271.748-271.753=-0.005
max271.760-271.764=-0.003
mean2845.000-2888.000=-43.000
σ0.000
min2845.000-2888.000=-43.000
max2845.000-2888.000=-43.000
mean0.384-0.384=0.001
σ0.008-0.005=0.003
min0.376-0.376=0.000
max0.396-0.391=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.183-1932.172=0.011
σ0.017-0.014=0.002
min1932.163-1932.154=0.009
max1932.208-1932.191=0.016
mean2845.000-2888.000=-43.000
σ0.000
min2845.000-2888.000=-43.000
max2845.000-2888.000=-43.000
mean2.856-3.016=-0.160
σ0.269-0.148=0.120
min2.472-2.763=-0.291
max3.101-3.118=-0.018
iters=5
new-facts=6402
prior-facts=1
mean4752.909-4752.890=0.019
σ0.940-0.928=0.012
min4752.374-4752.403=-0.028
max4754.579-4754.539=0.040
mean2845.000-2888.000=-43.000
σ0.000
min2845.000-2888.000=-43.000
max2845.000-2888.000=-43.000
mean8.601-8.638=-0.036
σ0.542-0.651=-0.109
min7.709-7.532=0.177
max9.113-9.079=0.034
iters=5
new-facts=6402
prior-facts=6402
mean4943.230-4943.299=-0.069
σ0.209-0.164=0.045
min4942.997-4943.006=-0.009
max4943.397-4943.390=0.007
mean3021.000-3034.000=-13.000
σ239.465-172.435=67.030
min2845.000-2888.000=-43.000
max3399.000-3310.000=89.000
mean8.484-8.644=-0.160
σ0.071-0.098=-0.027
min8.405-8.529=-0.124
max8.566-8.771=-0.205

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.034=-0.009
σ0.139-0.141=-0.001
min0.932-0.941=-0.009
max1.251-1.263=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.856-467.864=-0.008
σ575.928-575.924=0.004
min179.890-179.896=-0.007
max1331.749-1331.751=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2845.000-2888.000=-43.000
σ0.000
min2845.000-2888.000=-43.000
max2845.000-2888.000=-43.000
mean0.420-0.450=-0.030
σ0.260-0.306=-0.047
min0.277-0.293=-0.017
max0.809-0.909=-0.100
policies=20
mean1799.184-1799.182=0.002
σ0.381-0.377=0.004
min1798.925-1798.919=0.006
max1799.746-1799.737=0.008
mean820.000
σ0.000
min820.000
max820.000
mean2845.000-2888.000=-43.000
σ0.000
min2845.000-2888.000=-43.000
max2845.000-2888.000=-43.000
mean2.902-2.896=0.006
σ0.006-0.008=-0.002
min2.894-2.887=0.008
max2.908-2.907=0.001
policies=200
mean17998.544-17998.409=0.135
σ0.449-0.418=0.031
min17998.244-17998.078=0.166
max17999.211-17998.999=0.213
mean8200.000
σ0.000
min8200.000
max8200.000
mean2845.000-2888.000=-43.000
σ0.000
min2845.000-2888.000=-43.000
max2845.000-2888.000=-43.000
mean28.676-28.674=0.002
σ0.441-0.518=-0.077
min28.232-28.227=0.004
max29.188-29.262=-0.074