Compare commits

Home / Compare 9c1cb663 .. eafaf9cc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.692-55.692=0.000
σ0.052-0.051=0.001
min55.657-55.654=0.003
max55.834-55.831=0.003
mean419.300-416.000=3.300
σ0.483-0.000=0.483
min419.000-416.000=3.000
max420.000-416.000=4.000
mean0.136-0.136=0.000
σ0.004-0.005=-0.001
min0.129-0.129=0.000
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean44.204-44.205=-0.000
σ0.006-0.005=0.001
min44.195-44.196=-0.001
max44.211-44.211=0.001
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.121-0.118=0.003
σ0.004-0.005=-0.001
min0.118-0.113=0.006
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1763.720-1763.720=-0.001
σ0.367-0.366=0.002
min1763.143-1763.143=0.001
max1764.313-1764.311=0.002
mean1646.700-1645.050=1.650
σ636.043-639.371=-3.328
min648.000-643.000=5.000
max2843.000-2844.000=-1.000
mean2.346-2.346=0.000
σ0.084-0.083=0.002
min2.209-2.207=0.002
max2.583-2.559=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean343.134-343.136=-0.002
σ0.068-0.068=-0.001
min343.013-343.014=-0.001
max343.173-343.174=-0.002
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean0.443-0.438=0.005
σ0.005-0.005=0.000
min0.439-0.434=0.005
max0.449-0.447=0.003
iters=5
new-facts=1
prior-facts=6402
mean2003.705-2003.700=0.005
σ0.012-0.014=-0.002
min2003.684-2003.681=0.003
max2003.713
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean2.601-2.726=-0.125
σ0.095-0.168=-0.072
min2.508-2.551=-0.043
max2.714-2.968=-0.254
iters=5
new-facts=6402
prior-facts=1
mean4827.392-4827.423=-0.031
σ7.768-7.733=0.035
min4823.766-4823.753=0.013
max4841.285-4841.251=0.035
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean8.619-8.622=-0.003
σ0.840-0.976=-0.136
min7.720-7.779=-0.059
max9.424-9.986=-0.562
iters=5
new-facts=6402
prior-facts=6402
mean5014.857-5014.916=-0.060
σ0.123-0.031=0.091
min5014.644-5014.876=-0.232
max5014.950-5014.953=-0.004
mean3063.400-3059.000=4.400
σ291.733-288.020=3.713
min2843.000-2844.000=-1.000
max3516.000-3505.000=11.000
mean8.547-8.496=0.052
σ0.099-0.101=-0.002
min8.501-8.365=0.136
max8.725-8.635=0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.951-0.956=-0.005
σ0.057-0.061=-0.004
min0.914-0.920=-0.005
max1.049-1.062=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.060-465.045=0.015
σ574.253-574.250=0.003
min177.921-177.913=0.008
max1326.439-1326.420=0.019
mean88.250
σ8.500
min84.000
max101.000
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean0.465-0.421=0.045
σ0.365-0.292=0.074
min0.281-0.253=0.028
max1.013-0.858=0.156
policies=20
mean1779.500-1779.499=0.000
σ0.348-0.365=-0.017
min1779.290-1779.275=0.015
max1780.016-1780.041=-0.025
mean840.000
σ0.000
min840.000
max840.000
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean2.830-2.839=-0.008
σ0.014-0.002=0.012
min2.816-2.836=-0.020
max2.849-2.841=0.008
policies=200
mean17801.219-17801.168=0.052
σ0.707-0.688=0.019
min17800.192-17800.194=-0.002
max17801.723-17801.669=0.054
mean8400.000
σ0.000
min8400.000
max8400.000
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean28.265-28.273=-0.008
σ0.521-0.382=0.139
min27.703-27.899=-0.196
max28.878-28.723=0.155