Compare commits

Home / Compare 1c03e482 .. c361111e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.980=-0.002
σ0.049-0.049=0.000
min33.949-33.950=-0.001
max34.115-34.115=-0.000
mean420.000-414.000=6.000
σ0.000
min420.000-414.000=6.000
max420.000-414.000=6.000
mean0.080-0.084=-0.004
σ0.004-0.003=0.001
min0.076-0.082=-0.006
max0.085-0.090=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.001
σ0.003-0.002=0.001
min23.313-23.312=0.000
max23.324-23.320=0.005
mean420.000-414.000=6.000
σ0.000
min420.000-414.000=6.000
max420.000-414.000=6.000
mean0.066-0.065=0.001
σ0.003-0.002=0.001
min0.064-0.064=-0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.302=0.062
σ0.366-0.365=0.001
min1756.789-1756.729=0.059
max1757.954-1757.867=0.087
mean1663.700-1639.950=23.750
σ647.538-623.159=24.378
min627.000-623.000=4.000
max2817.000-2691.000=126.000
mean2.354-2.394=-0.040
σ0.110-0.123=-0.013
min2.210-2.249=-0.038
max2.637-2.682=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.480-326.440=0.040
σ0.048-0.060=-0.012
min326.397-326.334=0.063
max326.513-326.476=0.037
mean2817.000-2691.000=126.000
σ0.000
min2817.000-2691.000=126.000
max2817.000-2691.000=126.000
mean0.432-0.427=0.004
σ0.010-0.005=0.005
min0.422-0.424=-0.003
max0.445-0.436=0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.678-1988.616=0.062
σ0.004-0.012=-0.008
min1988.672-1988.596=0.076
max1988.684-1988.629=0.055
mean2817.000-2691.000=126.000
σ0.000
min2817.000-2691.000=126.000
max2817.000-2691.000=126.000
mean2.723-2.690=0.034
σ0.094-0.060=0.035
min2.667-2.641=0.025
max2.890-2.783=0.107
iters=5
new-facts=6402
prior-facts=1
mean4813.586-4813.495=0.091
σ7.755-7.702=0.053
min4809.964-4809.912=0.052
max4827.456-4827.271=0.184
mean2817.000-2691.000=126.000
σ0.000
min2817.000-2691.000=126.000
max2817.000-2691.000=126.000
mean8.493-8.313=0.180
σ0.924-0.600=0.325
min7.710-7.851=-0.141
max9.831-9.217=0.614
iters=5
new-facts=6402
prior-facts=6402
mean5001.077-5001.011=0.066
σ0.030-0.018=0.012
min5001.042-5000.989=0.052
max5001.119-5001.031=0.088
mean3054.600-2982.200=72.400
σ308.413-336.416=-28.003
min2817.000-2691.000=126.000
max3527.000-3478.000=49.000
mean9.829-9.601=0.228
σ0.112-0.404=-0.292
min9.714-8.888=0.826
max10.004-9.830=0.174

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.951-0.983=-0.032
σ0.066-0.081=-0.015
min0.908-0.914=-0.006
max1.065-1.091=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.505-464.441=0.064
σ574.772-574.769=0.003
min177.108-177.047=0.061
max1326.663-1326.594=0.069
mean88.250
σ8.500
min84.000
max101.000
mean2817.000-2691.000=126.000
σ0.000
min2817.000-2691.000=126.000
max2817.000-2691.000=126.000
mean0.437-0.535=-0.098
σ0.307-0.542=-0.234
min0.278-0.263=0.015
max0.898-1.348=-0.449
policies=20
mean1771.433-1770.771=0.662
σ0.368-0.349=0.019
min1771.175-1770.555=0.620
max1771.975-1771.291=0.683
mean840.000
σ0.000
min840.000
max840.000
mean2817.000-2691.000=126.000
σ0.000
min2817.000-2691.000=126.000
max2817.000-2691.000=126.000
mean2.818-2.725=0.093
σ0.026-0.010=0.016
min2.783-2.716=0.067
max2.843-2.737=0.106
policies=200
mean17720.994-17714.931=6.062
σ0.612-0.495=0.117
min17720.653-17714.600=6.054
max17721.911-17715.667=6.244
mean8400.000
σ0.000
min8400.000
max8400.000
mean2817.000-2691.000=126.000
σ0.000
min2817.000-2691.000=126.000
max2817.000-2691.000=126.000
mean27.594-27.539=0.054
σ0.119-0.086=0.033
min27.439-27.461=-0.022
max27.703-27.629=0.074