Compare commits

Home / Compare 163c13eb .. 89816b4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.264=-0.000
σ0.054-0.054=-0.000
min35.239-35.233=0.006
max35.416-35.416=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.086-0.085=0.000
σ0.004-0.003=0.000
min0.083-0.083=-0.000
max0.092-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.000
σ0.002-0.003=-0.001
min23.766-23.766=0.000
max23.774-23.774=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.069-0.068=0.000
σ0.003-0.003=0.000
min0.066-0.066=0.000
max0.075-0.076=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=-0.001
σ0.364-0.366=-0.002
min1755.910-1755.908=0.002
max1757.063-1757.077=-0.014
mean1657.650-1650.200=7.450
σ642.253-642.813=-0.560
min630.000-623.000=7.000
max2794.000-2835.000=-41.000
mean2.371-2.324=0.047
σ0.137-0.082=0.055
min2.188-2.224=-0.036
max2.789-2.497=0.292

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-324.704=0.007
σ0.058-0.055=0.003
min324.608-324.606=0.002
max324.742-324.733=0.009
mean2794.000-2835.000=-41.000
σ0.000
min2794.000-2835.000=-41.000
max2794.000-2835.000=-41.000
mean0.435-0.422=0.013
σ0.011-0.002=0.009
min0.423-0.422=0.001
max0.447-0.425=0.021
iters=5
new-facts=1
prior-facts=6402
mean1985.263-1985.272=-0.009
σ0.011-0.011=0.000
min1985.245-1985.255=-0.010
max1985.273-1985.282=-0.009
mean2794.000-2835.000=-41.000
σ0.000
min2794.000-2835.000=-41.000
max2794.000-2835.000=-41.000
mean2.574-2.564=0.009
σ0.044-0.090=-0.046
min2.536-2.463=0.074
max2.648-2.672=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4808.778-4808.881=-0.104
σ7.739-7.662=0.077
min4804.857-4805.419=-0.562
max4822.612-4822.587=0.026
mean2794.000-2835.000=-41.000
σ0.000
min2794.000-2835.000=-41.000
max2794.000-2835.000=-41.000
mean8.680-9.034=-0.353
σ0.364-0.313=0.052
min8.106-8.816=-0.710
max9.061-9.567=-0.505
iters=5
new-facts=6402
prior-facts=6402
mean4996.471-4996.469=0.002
σ0.010-0.022=-0.012
min4996.462-4996.441=0.021
max4996.483-4996.490=-0.007
mean3066.000-3039.600=26.400
σ242.328-183.470=58.858
min2794.000-2835.000=-41.000
max3415.000-3302.000=113.000
mean8.663-8.696=-0.034
σ0.165-0.277=-0.112
min8.440-8.451=-0.011
max8.862-9.009=-0.147

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-0.916=0.060
σ0.144-0.014=0.130
min0.907-0.907=-0.001
max1.234-0.941=0.293

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.973=-0.002
σ574.250-574.261=-0.011
min175.836-175.835=0.001
max1324.346-1324.364=-0.018
mean86.250
σ8.500
min82.000
max99.000
mean2794.000-2835.000=-41.000
σ0.000
min2794.000-2835.000=-41.000
max2794.000-2835.000=-41.000
mean0.426-0.432=-0.006
σ0.290-0.298=-0.007
min0.276-0.281=-0.005
max0.862-0.878=-0.017
policies=20
mean1758.688-1758.724=-0.036
σ0.353-0.339=0.014
min1758.441-1758.510=-0.068
max1759.211-1759.229=-0.018
mean820.000
σ0.000
min820.000
max820.000
mean2794.000-2835.000=-41.000
σ0.000
min2794.000-2835.000=-41.000
max2794.000-2835.000=-41.000
mean2.819-2.783=0.036
σ0.079-0.013=0.066
min2.766-2.771=-0.005
max2.936-2.801=0.136
policies=200
mean17592.375-17593.278=-0.903
σ0.560-0.679=-0.119
min17591.974-17592.404=-0.430
max17593.198-17593.913=-0.714
mean8200.000
σ0.000
min8200.000
max8200.000
mean2794.000-2835.000=-41.000
σ0.000
min2794.000-2835.000=-41.000
max2794.000-2835.000=-41.000
mean27.403-27.848=-0.445
σ0.080-0.253=-0.173
min27.314-27.631=-0.318
max27.504-28.171=-0.667