Compare commits

Home / Compare 985a5abb .. c7f695f0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.000
σ0.056-0.054=0.002
min35.585-35.589=-0.004
max35.775-35.771=0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.086-0.085=0.001
σ0.004-0.004=0.000
min0.083-0.082=0.001
max0.093-0.093=0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.000
σ0.003-0.004=-0.001
min24.043-24.042=0.002
max24.053-24.053=-0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.068-0.066=0.001
σ0.002-0.004=-0.002
min0.066-0.061=0.005
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.364-0.365=-0.001
min1755.914-1755.917=-0.002
max1757.075-1757.083=-0.008
mean1639.600-1646.750=-7.150
σ604.977-641.579=-36.601
min659.000-631.000=28.000
max2452.000-2839.000=-387.000
mean2.368-2.356=0.011
σ0.111-0.076=0.035
min2.208-2.275=-0.067
max2.752-2.550=0.203

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.767=-0.001
σ0.043-0.047=-0.004
min324.690-324.685=0.005
max324.794-324.800=-0.006
mean2452.000-2839.000=-387.000
σ0.000
min2452.000-2839.000=-387.000
max2452.000-2839.000=-387.000
mean0.430-0.428=0.002
σ0.009-0.008=0.001
min0.422-0.423=-0.002
max0.441-0.442=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.318-1985.327=-0.009
σ0.014-0.005=0.008
min1985.302-1985.318=-0.016
max1985.333-1985.331=0.002
mean2452.000-2839.000=-387.000
σ0.000
min2452.000-2839.000=-387.000
max2452.000-2839.000=-387.000
mean2.686-2.623=0.064
σ0.116-0.086=0.030
min2.572-2.529=0.042
max2.818-2.731=0.086
iters=5
new-facts=6402
prior-facts=1
mean4809.072-4809.018=0.055
σ7.661-7.774=-0.113
min4805.605-4804.984=0.621
max4822.777-4822.911=-0.135
mean2452.000-2839.000=-387.000
σ0.000
min2452.000-2839.000=-387.000
max2452.000-2839.000=-387.000
mean8.699-9.015=-0.317
σ0.129-0.426=-0.298
min8.526-8.339=0.186
max8.869-9.479=-0.610
iters=5
new-facts=6402
prior-facts=6402
mean4996.567-4996.623=-0.055
σ0.148-0.025=0.123
min4996.307-4996.600=-0.293
max4996.660-4996.664=-0.004
mean2996.400-3063.400=-67.000
σ371.884-306.063=65.822
min2522.000-2839.000=-317.000
max3355.000-3539.000=-184.000
mean8.792-8.558=0.234
σ0.176-0.092=0.084
min8.623-8.465=0.158
max9.088-8.710=0.378

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.822-0.973=0.848
σ0.057-0.068=-0.011
min1.737-0.912=0.826
max1.884-1.061=0.824

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.200-463.217=-0.016
σ574.759-574.772=-0.013
min175.818-175.821=-0.003
max1325.338-1325.374=-0.036
mean86.250
σ8.500
min82.000
max99.000
mean2452.000-2839.000=-387.000
σ0.000
min2452.000-2839.000=-387.000
max2452.000-2839.000=-387.000
mean0.548-0.428=0.121
σ0.543-0.290=0.253
min0.274-0.281=-0.007
max1.363-0.863=0.500
policies=20
mean1758.487-1758.535=-0.049
σ0.339-0.352=-0.014
min1758.264-1758.296=-0.032
max1758.990-1759.056=-0.066
mean820.000
σ0.000
min820.000
max820.000
mean2452.000-2839.000=-387.000
σ0.000
min2452.000-2839.000=-387.000
max2452.000-2839.000=-387.000
mean2.722-2.812=-0.090
σ0.014-0.021=-0.007
min2.703-2.796=-0.093
max2.734-2.843=-0.109
policies=200
mean17592.001-17592.114=-0.113
σ0.493-0.411=0.081
min17591.667-17591.676=-0.009
max17592.712-17592.669=0.043
mean8200.000
σ0.000
min8200.000
max8200.000
mean2452.000-2839.000=-387.000
σ0.000
min2452.000-2839.000=-387.000
max2452.000-2839.000=-387.000
mean27.354-27.892=-0.539
σ0.076-0.396=-0.320
min27.283-27.524=-0.241
max27.423-28.327=-0.904