Compare commits

Home / Compare fad56d26 .. 349253c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-35.617=-1.639
σ0.048-0.055=-0.006
min33.941-35.590=-1.648
max34.112-35.771=-1.660
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.081-0.083=-0.002
σ0.004-0.005=-0.001
min0.076-0.077=-0.002
max0.087-0.095=-0.008
cache=y
dps=1
iters=10
policies=100
mean23.319-24.047=-0.728
σ0.003-0.003=0.001
min23.314-24.042=-0.728
max23.324-24.051=-0.727
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.066-0.066=-0.000
σ0.003-0.003=-0.000
min0.063-0.060=0.003
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1756.490=0.813
σ0.363-0.364=-0.001
min1756.728-1755.917=0.811
max1757.890-1757.078=0.812
mean1645.550-1652.950=-7.400
σ623.644-627.140=-3.495
min636.000-622.000=14.000
max2823.000-2684.000=139.000
mean2.356-2.350=0.006
σ0.094-0.106=-0.012
min2.232-2.236=-0.004
max2.651-2.630=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.455-324.770=1.685
σ0.030-0.032=-0.003
min326.403-324.716=1.687
max326.475-324.802=1.673
mean2823.000-2684.000=139.000
σ0.000
min2823.000-2684.000=139.000
max2823.000-2684.000=139.000
mean0.422-0.418=0.004
σ0.002-0.008=-0.006
min0.420-0.412=0.008
max0.425-0.432=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.619-1985.323=3.295
σ0.005-0.013=-0.008
min1988.613-1985.302=3.312
max1988.625-1985.336=3.290
mean2823.000-2684.000=139.000
σ0.000
min2823.000-2684.000=139.000
max2823.000-2684.000=139.000
mean2.712-2.620=0.092
σ0.109-0.083=0.026
min2.635-2.555=0.080
max2.897-2.738=0.159
iters=5
new-facts=6402
prior-facts=1
mean4813.458-4809.089=4.369
σ7.698-7.725=-0.027
min4809.943-4805.571=4.373
max4827.229-4822.908=4.321
mean2823.000-2684.000=139.000
σ0.000
min2823.000-2684.000=139.000
max2823.000-2684.000=139.000
mean8.779-8.957=-0.178
σ0.293-0.258=0.035
min8.414-8.667=-0.253
max9.119-9.285=-0.166
iters=5
new-facts=6402
prior-facts=6402
mean5000.871-4996.559=4.312
σ0.328-0.155=0.173
min5000.285-4996.284=4.001
max5001.037-4996.658=4.380
mean3036.400-3041.800=-5.400
σ194.235-270.855=-76.620
min2823.000-2684.000=139.000
max3314.000-3403.000=-89.000
mean9.686-8.681=1.005
σ0.285-0.242=0.043
min9.265-8.361=0.904
max10.020-8.977=1.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-0.947=0.109
σ0.169-0.054=0.115
min0.918-0.916=0.003
max1.333-1.041=0.292

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.440-463.210=1.230
σ574.773-574.774=-0.001
min177.043-175.811=1.232
max1326.599-1325.371=1.228
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2823.000-2684.000=139.000
σ0.000
min2823.000-2684.000=139.000
max2823.000-2684.000=139.000
mean0.410-0.532=-0.122
σ0.265-0.518=-0.253
min0.276-0.271=0.005
max0.807-1.309=-0.501
policies=20
mean1770.787-1758.485=12.302
σ0.379-0.324=0.056
min1770.532-1758.273=12.259
max1771.351-1758.966=12.385
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2823.000-2684.000=139.000
σ0.000
min2823.000-2684.000=139.000
max2823.000-2684.000=139.000
mean2.798-2.701=0.096
σ0.021-0.018=0.003
min2.782-2.682=0.100
max2.828-2.724=0.104
policies=200
mean17715.029-17592.068=122.960
σ0.438-0.481=-0.043
min17714.730-17591.804=122.926
max17715.679-17592.789=122.890
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2823.000-2684.000=139.000
σ0.000
min2823.000-2684.000=139.000
max2823.000-2684.000=139.000
mean27.940-27.303=0.636
σ0.428-0.173=0.254
min27.511-27.149=0.362
max28.315-27.493=0.822