Compare commits

Home / Compare 7f9b39ca .. 14ac1954

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.047-0.050=-0.003
min33.950-33.949=0.001
max34.108-34.115=-0.008
mean414.000-414.900=-0.900
σ0.000-0.316=-0.316
min414.000
max414.000-415.000=-1.000
mean0.082-0.083=-0.001
σ0.004-0.002=0.002
min0.076-0.080=-0.003
max0.089-0.089=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.004-0.003=0.000
min23.310-23.313=-0.003
max23.324-23.324=-0.000
mean414.000-415.600=-1.600
σ0.000-0.516=-0.516
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.065-0.065=-0.001
σ0.002-0.003=-0.001
min0.063-0.063=0.000
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.365-1757.364=0.002
σ0.365-0.367=-0.002
min1756.788-1756.790=-0.002
max1757.952-1757.955=-0.003
mean1660.650-1652.600=8.050
σ620.397-627.555=-7.158
min669.000-633.000=36.000
max2587.000-2836.000=-249.000
mean2.381-2.384=-0.004
σ0.114-0.117=-0.003
min2.256-2.257=-0.001
max2.691-2.808=-0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.511-326.517=-0.007
σ0.034-0.032=0.002
min326.451-326.461=-0.010
max326.536-326.541=-0.005
mean2587.000-2836.000=-249.000
σ0.000
min2587.000-2836.000=-249.000
max2587.000-2836.000=-249.000
mean0.424-0.427=-0.003
σ0.003-0.005=-0.002
min0.421-0.421=-0.000
max0.429-0.433=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.673-1988.667=0.005
σ0.012-0.018=-0.007
min1988.653-1988.644=0.009
max1988.682-1988.683=-0.001
mean2587.000-2836.000=-249.000
σ0.000
min2587.000-2836.000=-249.000
max2587.000-2836.000=-249.000
mean2.698-2.753=-0.054
σ0.090-0.228=-0.138
min2.617-2.627=-0.010
max2.798-3.157=-0.360
iters=5
new-facts=6402
prior-facts=1
mean4813.509-4813.510=-0.002
σ7.724-7.725=-0.000
min4809.980-4809.980=-0.000
max4827.326-4827.328=-0.002
mean2587.000-2836.000=-249.000
σ0.000
min2587.000-2836.000=-249.000
max2587.000-2836.000=-249.000
mean8.747-8.695=0.051
σ0.272-0.236=0.036
min8.459-8.452=0.007
max9.180-9.066=0.114
iters=5
new-facts=6402
prior-facts=6402
mean5001.076-5000.948=0.129
σ0.031-0.213=-0.182
min5001.047-5000.713=0.334
max5001.123-5001.131=-0.008
mean2959.800-3037.800=-78.000
σ254.740-210.010=44.730
min2637.000-2836.000=-199.000
max3303.000-3337.000=-34.000
mean9.905-9.855=0.050
σ0.201-0.380=-0.179
min9.710-9.183=0.527
max10.242-10.086=0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.271-0.975=0.296
σ0.427-0.067=0.359
min0.913-0.915=-0.003
max1.836-1.053=0.783

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.503-464.508=-0.005
σ574.793-574.773=0.020
min177.103-177.109=-0.006
max1326.692-1326.667=0.026
mean88.250
σ8.500
min84.000
max101.000
mean2587.000-2836.000=-249.000
σ0.000
min2587.000-2836.000=-249.000
max2587.000-2836.000=-249.000
mean0.541-0.433=0.108
σ0.530-0.308=0.222
min0.274-0.278=-0.004
max1.337-0.896=0.441
policies=20
mean1771.349-1771.421=-0.072
σ0.358-0.375=-0.018
min1771.121-1771.160=-0.038
max1771.881-1771.976=-0.095
mean840.000
σ0.000
min840.000
max840.000
mean2587.000-2836.000=-249.000
σ0.000
min2587.000-2836.000=-249.000
max2587.000-2836.000=-249.000
mean2.734-2.810=-0.076
σ0.030-0.026=0.004
min2.704-2.773=-0.068
max2.763-2.830=-0.067
policies=200
mean17721.033-17720.874=0.159
σ0.617-0.153=0.463
min17720.643-17720.652=-0.009
max17721.953-17720.989=0.964
mean8400.000
σ0.000
min8400.000
max8400.000
mean2587.000-2836.000=-249.000
σ0.000
min2587.000-2836.000=-249.000
max2587.000-2836.000=-249.000
mean27.574-27.923=-0.348
σ0.282-0.400=-0.117
min27.380-27.530=-0.150
max27.983-28.396=-0.413