Compare commits

Home / Compare 90326fe8 .. 6826b1c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.048-0.050=-0.002
min33.949-33.952=-0.003
max34.110-34.119=-0.009
mean412.000-412.900=-0.900
σ0.000-0.316=-0.316
min412.000
max412.000-413.000=-1.000
mean0.081-0.082=-0.002
σ0.005-0.005=0.000
min0.076-0.076=-0.000
max0.088-0.088=0.000
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.001
σ0.002-0.003=-0.000
min23.313-23.314=-0.001
max23.322-23.323=-0.000
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.064-0.066=-0.001
σ0.003-0.003=0.000
min0.061-0.064=-0.003
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.430=0.064
σ0.365-0.365=-0.001
min1756.919-1756.853=0.066
max1758.082-1758.017=0.065
mean1644.700-1663.450=-18.750
σ625.264-627.322=-2.058
min634.000-669.000=-35.000
max2833.000-2611.000=222.000
mean2.394-2.349=0.045
σ0.087-0.129=-0.041
min2.284-2.154=0.130
max2.670-2.751=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.577=0.061
σ0.060-0.031=0.030
min326.532-326.523=0.009
max326.681-326.597=0.084
mean2833.000-2611.000=222.000
σ0.000
min2833.000-2611.000=222.000
max2833.000-2611.000=222.000
mean0.432-0.422=0.010
σ0.010-0.001=0.009
min0.425-0.421=0.004
max0.449-0.423=0.026
iters=5
new-facts=1
prior-facts=6402
mean1988.803-1988.742=0.061
σ0.011-0.009=0.002
min1988.790-1988.728=0.062
max1988.815-1988.752=0.063
mean2833.000-2611.000=222.000
σ0.000
min2833.000-2611.000=222.000
max2833.000-2611.000=222.000
mean2.727-2.716=0.012
σ0.076-0.053=0.023
min2.636-2.657=-0.020
max2.841-2.798=0.043
iters=5
new-facts=6402
prior-facts=1
mean4813.702-4813.402=0.300
σ7.753-7.183=0.569
min4810.122-4810.043=0.079
max4827.569-4826.250=1.319
mean2833.000-2611.000=222.000
σ0.000
min2833.000-2611.000=222.000
max2833.000-2611.000=222.000
mean8.761-8.227=0.535
σ0.642-0.552=0.089
min7.727-7.806=-0.079
max9.358-9.112=0.246
iters=5
new-facts=6402
prior-facts=6402
mean5001.203-5001.138=0.065
σ0.015-0.026=-0.011
min5001.189-5001.105=0.084
max5001.224-5001.160=0.064
mean3007.400-2980.400=27.000
σ237.126-406.012=-168.886
min2833.000-2611.000=222.000
max3381.000-3554.000=-173.000
mean9.736-9.807=-0.071
σ0.233-0.174=0.059
min9.386-9.574=-0.188
max10.005-10.000=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.252=-0.252
σ0.067-0.409=-0.342
min0.917-0.919=-0.001
max1.051-1.824=-0.773

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.566=0.063
σ574.770-574.789=-0.019
min177.236-177.168=0.069
max1326.784-1326.749=0.035
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2611.000=222.000
σ0.000
min2833.000-2611.000=222.000
max2833.000-2611.000=222.000
mean0.437-0.546=-0.109
σ0.305-0.544=-0.239
min0.282-0.271=0.011
max0.895-1.361=-0.467
policies=20
mean1772.685-1772.028=0.657
σ0.369-0.343=0.026
min1772.427-1771.799=0.627
max1773.229-1772.538=0.691
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2611.000=222.000
σ0.000
min2833.000-2611.000=222.000
max2833.000-2611.000=222.000
mean2.804-2.711=0.094
σ0.011-0.017=-0.006
min2.788-2.687=0.101
max2.812-2.725=0.088
policies=200
mean17734.019-17727.642=6.376
σ0.516-0.517=-0.001
min17733.701-17727.343=6.358
max17734.789-17728.416=6.373
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2611.000=222.000
σ0.000
min2833.000-2611.000=222.000
max2833.000-2611.000=222.000
mean28.004-27.497=0.508
σ0.449-0.128=0.322
min27.607-27.332=0.275
max28.495-27.641=0.854