Compare commits

Home / Compare a614673e .. 773348d0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=0.001
σ0.049-0.048=0.001
min30.726-30.728=-0.002
max30.904-30.901=0.003
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.079-0.076=0.002
σ0.004-0.005=-0.002
min0.076-0.071=0.005
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.003-0.003=-0.000
min21.056-21.055=0.002
max21.065-21.064=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.062-0.061=0.001
σ0.003-0.003=-0.000
min0.058-0.057=0.001
max0.068-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.420=-0.001
σ0.360-0.361=-0.001
min1750.851-1750.858=-0.006
max1751.992-1752.007=-0.015
mean1648.450-1658.550=-10.100
σ622.010-634.313=-12.303
min682.000-617.000=65.000
max2647.000-2772.000=-125.000
mean2.787-2.813=-0.027
σ0.206-0.198=0.009
min2.369-2.323=0.046
max3.067-3.149=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.762-275.760=0.002
σ0.009-0.010=-0.001
min275.752-275.747=0.005
max275.772-275.773=-0.000
mean2647.000-2772.000=-125.000
σ0.000
min2647.000-2772.000=-125.000
max2647.000-2772.000=-125.000
mean0.405-0.408=-0.003
σ0.010-0.008=0.002
min0.396-0.399=-0.003
max0.418-0.417=0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.279-2168.290=-0.012
σ0.015-0.007=0.009
min2168.260-2168.285=-0.025
max2168.293-2168.299=-0.007
mean2647.000-2772.000=-125.000
σ0.000
min2647.000-2772.000=-125.000
max2647.000-2772.000=-125.000
mean2.955-3.014=-0.058
σ0.154-0.134=0.020
min2.768-2.834=-0.066
max3.134-3.161=-0.027
iters=5
new-facts=6402
prior-facts=1
mean5047.986-5048.100=-0.114
σ0.634-0.926=-0.292
min5047.605-5047.616=-0.011
max5049.101-5049.753=-0.652
mean2647.000-2772.000=-125.000
σ0.000
min2647.000-2772.000=-125.000
max2647.000-2772.000=-125.000
mean8.882-8.721=0.161
σ0.476-0.377=0.099
min8.144-8.096=0.048
max9.410-9.081=0.329
iters=5
new-facts=6402
prior-facts=6402
mean5179.161-5179.241=-0.080
σ0.126-0.083=0.044
min5178.962-5179.172=-0.210
max5179.310-5179.335=-0.025
mean3236.200-3234.600=1.600
σ339.342-363.081=-23.739
min2789.000-2772.000=17.000
max3685.000-3728.000=-43.000
mean9.886-9.932=-0.047
σ0.265-0.223=0.042
min9.438-9.550=-0.112
max10.150-10.117=0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.186-1.039=0.147
σ0.228-0.141=0.088
min0.953-0.946=0.007
max1.544-1.264=0.280

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.564-463.574=-0.010
σ572.650-572.650=-0.000
min177.234-177.243=-0.009
max1322.539-1322.549=-0.010
mean79.750
σ7.500
min76.000
max91.000
mean2647.000-2772.000=-125.000
σ0.000
min2647.000-2772.000=-125.000
max2647.000-2772.000=-125.000
mean0.554-0.443=0.111
σ0.556-0.309=0.247
min0.275-0.286=-0.011
max1.387-0.906=0.481
policies=20
mean1772.612-1772.658=-0.045
σ0.332-0.326=0.006
min1772.393-1772.419=-0.027
max1773.106-1773.135=-0.029
mean760.000
σ0.000
min760.000
max760.000
mean2647.000-2772.000=-125.000
σ0.000
min2647.000-2772.000=-125.000
max2647.000-2772.000=-125.000
mean2.751-2.848=-0.098
σ0.007-0.128=-0.122
min2.745-2.758=-0.013
max2.759-3.031=-0.272
policies=200
mean17732.921-17733.040=-0.119
σ0.412-0.496=-0.084
min17732.627-17732.722=-0.095
max17733.523-17733.780=-0.256
mean7600.000
σ0.000
min7600.000
max7600.000
mean2647.000-2772.000=-125.000
σ0.000
min2647.000-2772.000=-125.000
max2647.000-2772.000=-125.000
mean27.792-27.881=-0.089
σ0.112-0.204=-0.092
min27.695-27.633=0.062
max27.904-28.122=-0.217