Compare commits

Home / Compare 5e8df37d .. 5b3d58d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.569-70.568=0.000
σ0.045-0.044=0.001
min70.547-70.545=0.003
max70.696-70.692=0.004
mean413.000-413.800=-0.800
σ0.000-0.422=-0.422
min413.000
max413.000-414.000=-1.000
mean0.159-0.159=0.001
σ0.002-0.003=-0.001
min0.157-0.155=0.002
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.292-21.294=-0.002
σ0.003-0.011=-0.008
min21.287-21.287=0.000
max21.297-21.324=-0.027
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.065=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=-0.000
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1753.173=0.000
σ0.359-0.360=-0.001
min1752.610-1752.600=0.010
max1753.755-1753.760=-0.005
mean1660.250-1649.800=10.450
σ641.088-615.470=25.618
min692.000-668.000=24.000
max2902.000-2652.000=250.000
mean2.867-2.879=-0.012
σ0.154-0.131=0.023
min2.341-2.544=-0.203
max3.070-3.211=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.621-271.619=0.002
σ0.005-0.008=-0.003
min271.614-271.611=0.003
max271.625-271.629=-0.003
mean2902.000-2652.000=250.000
σ0.000
min2902.000-2652.000=250.000
max2902.000-2652.000=250.000
mean0.376-0.376=0.001
σ0.008-0.007=0.001
min0.371-0.371=-0.001
max0.390-0.388=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.036-1932.040=-0.005
σ0.009-0.005=0.004
min1932.026-1932.036=-0.010
max1932.047-1932.048=-0.001
mean2902.000-2652.000=250.000
σ0.000
min2902.000-2652.000=250.000
max2902.000-2652.000=250.000
mean2.999-3.068=-0.069
σ0.068-0.159=-0.091
min2.921-2.938=-0.017
max3.102-3.319=-0.217
iters=5
new-facts=6402
prior-facts=1
mean4752.711-4752.599=0.112
σ0.935-1.048=-0.113
min4751.980-4751.709=0.271
max4754.344-4754.363=-0.019
mean2902.000-2652.000=250.000
σ0.000
min2902.000-2652.000=250.000
max2902.000-2652.000=250.000
mean8.665-8.350=0.315
σ0.525-0.469=0.056
min7.950-7.675=0.275
max9.407-8.944=0.462
iters=5
new-facts=6402
prior-facts=6402
mean4943.166-4943.168=-0.002
σ0.153-0.147=0.006
min4942.892-4942.906=-0.015
max4943.242-4943.251=-0.008
mean3030.800-3025.400=5.400
σ156.771-302.307=-145.535
min2902.000-2652.000=250.000
max3286.000-3317.000=-31.000
mean8.595-8.887=-0.291
σ0.135-0.416=-0.281
min8.469-8.448=0.021
max8.812-9.368=-0.556

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.202=-0.171
σ0.142-0.295=-0.153
min0.936-0.934=0.002
max1.263-1.690=-0.428

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.291-472.287=0.004
σ575.921-575.927=-0.006
min184.321-184.320=0.001
max1336.173-1336.177=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2902.000-2652.000=250.000
σ0.000
min2902.000-2652.000=250.000
max2902.000-2652.000=250.000
mean0.486-0.557=-0.071
σ0.379-0.542=-0.163
min0.292-0.282=0.010
max1.055-1.370=-0.315
policies=20
mean1843.554-1843.535=0.019
σ0.376-0.384=-0.008
min1843.280-1843.268=0.012
max1844.103-1844.101=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2902.000-2652.000=250.000
σ0.000
min2902.000-2652.000=250.000
max2902.000-2652.000=250.000
mean2.944-2.879=0.066
σ0.006-0.011=-0.005
min2.937-2.863=0.074
max2.950-2.886=0.065
policies=200
mean18442.080-18441.910=0.170
σ0.410-0.608=-0.198
min18441.776-18441.547=0.229
max18442.683-18442.814=-0.130
mean8400.000
σ0.000
min8400.000
max8400.000
mean2902.000-2652.000=250.000
σ0.000
min2902.000-2652.000=250.000
max2902.000-2652.000=250.000
mean29.391-28.918=0.473
σ0.553-0.221=0.332
min28.788-28.612=0.176
max30.007-29.139=0.868