Compare commits

Home / Compare 597afee5 .. d0bac364

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-70.567=-34.950
σ0.054-0.045=0.009
min35.591-70.542=-34.951
max35.771-70.692=-34.921
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.086-0.159=-0.073
σ0.004-0.004=0.000
min0.082-0.152=-0.070
max0.092-0.166=-0.074
cache=y
dps=1
iters=10
policies=100
mean24.047-21.288=2.759
σ0.002-0.003=-0.001
min24.042-21.285=2.758
max24.049-21.293=2.757
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.068-0.065=0.003
σ0.003-0.004=-0.000
min0.066-0.063=0.003
max0.075-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1753.567=2.923
σ0.365-0.360=0.005
min1755.914-1752.995=2.919
max1757.082-1754.152=2.930
mean1652.250-1654.650=-2.400
σ629.269-643.271=-14.002
min621.000-627.000=-6.000
max2702.000-2884.000=-182.000
mean2.359-2.775=-0.417
σ0.144-0.137=0.007
min2.191-2.531=-0.340
max2.779-3.009=-0.230

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.764-272.016=52.748
σ0.050-0.008=0.042
min324.676-272.006=52.669
max324.790-272.028=52.761
mean2702.000-2884.000=-182.000
σ0.000
min2702.000-2884.000=-182.000
max2702.000-2884.000=-182.000
mean0.426-0.391=0.036
σ0.008-0.011=-0.003
min0.421-0.379=0.042
max0.440-0.403=0.036
iters=5
new-facts=1
prior-facts=6402
mean1985.324-1932.434=52.890
σ0.009-0.006=0.003
min1985.309-1932.425=52.884
max1985.331-1932.440=52.891
mean2702.000-2884.000=-182.000
σ0.000
min2702.000-2884.000=-182.000
max2702.000-2884.000=-182.000
mean2.631-2.969=-0.338
σ0.201-0.148=0.054
min2.430-2.773=-0.343
max2.951-3.184=-0.232
iters=5
new-facts=6402
prior-facts=1
mean4809.094-4753.183=55.911
σ7.666-0.831=6.835
min4805.615-4752.691=52.924
max4822.807-4754.663=68.144
mean2702.000-2884.000=-182.000
σ0.000
min2702.000-2884.000=-182.000
max2702.000-2884.000=-182.000
mean8.976-8.429=0.547
σ0.187-0.382=-0.196
min8.711-7.828=0.883
max9.228-8.856=0.371
iters=5
new-facts=6402
prior-facts=6402
mean4996.631-4943.630=53.000
σ0.025-0.020=0.005
min4996.595-4943.607=52.988
max4996.659-4943.657=53.002
mean3027.000-3064.400=-37.400
σ275.312-201.402=73.910
min2702.000-2884.000=-182.000
max3404.000-3374.000=30.000
mean8.596-8.710=-0.114
σ0.113-0.211=-0.098
min8.445-8.482=-0.036
max8.734-8.927=-0.193

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.000=0.056
σ0.171-0.142=0.029
min0.917-0.933=-0.016
max1.338-1.255=0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.213-473.077=-9.865
σ574.772-575.915=-1.143
min175.816-185.112=-9.297
max1325.370-1336.949=-11.579
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2702.000-2884.000=-182.000
σ0.000
min2702.000-2884.000=-182.000
max2702.000-2884.000=-182.000
mean0.532-0.490=0.042
σ0.519-0.379=0.140
min0.264-0.298=-0.034
max1.310-1.058=0.252
policies=20
mean1758.499-1851.446=-92.947
σ0.330-0.371=-0.040
min1758.296-1851.166=-92.871
max1758.991-1851.986=-92.995
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2702.000-2884.000=-182.000
σ0.000
min2702.000-2884.000=-182.000
max2702.000-2884.000=-182.000
mean2.717-2.952=-0.235
σ0.012-0.013=-0.002
min2.705-2.937=-0.232
max2.732-2.965=-0.233
policies=200
mean17592.147-18521.067=-928.920
σ0.497-0.432=0.065
min17591.851-18520.759=-928.908
max17592.890-18521.705=-928.815
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2702.000-2884.000=-182.000
σ0.000
min2702.000-2884.000=-182.000
max2702.000-2884.000=-182.000
mean27.373-29.331=-1.958
σ0.064-0.494=-0.430
min27.301-28.884=-1.582
max27.446-29.887=-2.441