Compare commits

Home / Compare af647084 .. 9efa40bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.048-0.048=-0.000
min33.950-33.949=0.001
max34.111-34.110=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.082-0.081=0.001
σ0.005-0.005=0.000
min0.078-0.076=0.002
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.000
σ0.002-0.002=-0.001
min23.312-23.313=-0.001
max23.319-23.322=-0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.064-0.064=-0.000
σ0.004-0.003=0.001
min0.060-0.061=-0.001
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.494=0.001
σ0.363-0.365=-0.002
min1756.922-1756.919=0.004
max1758.081-1758.082=-0.001
mean1661.450-1644.700=16.750
σ623.100-625.264=-2.164
min662.000-634.000=28.000
max2597.000-2833.000=-236.000
mean2.419-2.394=0.026
σ0.129-0.087=0.042
min2.288-2.284=0.004
max2.775-2.670=0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.638=-0.000
σ0.047-0.060=-0.013
min326.555-326.532=0.023
max326.676-326.681=-0.005
mean2597.000-2833.000=-236.000
σ0.000
min2597.000-2833.000=-236.000
max2597.000-2833.000=-236.000
mean0.423-0.432=-0.009
σ0.001-0.010=-0.009
min0.422-0.425=-0.003
max0.424-0.449=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1988.806-1988.803=0.004
σ0.010-0.011=-0.001
min1988.788-1988.790=-0.002
max1988.814-1988.815=-0.001
mean2597.000-2833.000=-236.000
σ0.000
min2597.000-2833.000=-236.000
max2597.000-2833.000=-236.000
mean2.696-2.727=-0.032
σ0.074-0.076=-0.003
min2.613-2.636=-0.024
max2.801-2.841=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4813.669-4813.702=-0.033
σ7.710-7.753=-0.043
min4810.133-4810.122=0.011
max4827.460-4827.569=-0.110
mean2597.000-2833.000=-236.000
σ0.000
min2597.000-2833.000=-236.000
max2597.000-2833.000=-236.000
mean8.601-8.761=-0.160
σ0.590-0.642=-0.051
min7.690-7.727=-0.036
max9.136-9.358=-0.222
iters=5
new-facts=6402
prior-facts=6402
mean5001.000-5001.203=-0.203
σ0.310-0.015=0.296
min5000.519-5001.189=-0.670
max5001.231-5001.224=0.007
mean2994.000-3007.400=-13.400
σ271.282-237.126=34.156
min2602.000-2833.000=-231.000
max3324.000-3381.000=-57.000
mean9.879-9.736=0.143
σ0.251-0.233=0.018
min9.614-9.386=0.229
max10.292-10.005=0.286

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.284-1.000=0.284
σ0.381-0.067=0.314
min0.944-0.917=0.027
max1.822-1.051=0.771

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.634-464.629=0.005
σ574.786-574.770=0.015
min177.236-177.236=-0.000
max1326.813-1326.784=0.029
mean88.250
σ8.500
min84.000
max101.000
mean2597.000-2833.000=-236.000
σ0.000
min2597.000-2833.000=-236.000
max2597.000-2833.000=-236.000
mean0.570-0.437=0.133
σ0.587-0.305=0.281
min0.275-0.282=-0.007
max1.450-0.895=0.555
policies=20
mean1772.682-1772.685=-0.003
σ0.356-0.369=-0.013
min1772.456-1772.427=0.029
max1773.212-1773.229=-0.017
mean840.000
σ0.000
min840.000
max840.000
mean2597.000-2833.000=-236.000
σ0.000
min2597.000-2833.000=-236.000
max2597.000-2833.000=-236.000
mean2.732-2.804=-0.073
σ0.007-0.011=-0.003
min2.724-2.788=-0.064
max2.742-2.812=-0.071
policies=200
mean17734.072-17734.019=0.054
σ0.531-0.516=0.015
min17733.754-17733.701=0.053
max17734.865-17734.789=0.076
mean8400.000
σ0.000
min8400.000
max8400.000
mean2597.000-2833.000=-236.000
σ0.000
min2597.000-2833.000=-236.000
max2597.000-2833.000=-236.000
mean27.565-28.004=-0.439
σ0.148-0.449=-0.301
min27.418-27.607=-0.189
max27.759-28.495=-0.736