Compare commits

Home / Compare 5b25938f .. 4e57cc68

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.047=0.001
min33.951-33.949=0.002
max34.113-34.109=0.005
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.087-0.082=0.005
σ0.004-0.005=-0.001
min0.084-0.076=0.008
max0.093-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.319-23.316=0.002
σ0.003-0.003=0.000
min23.314-23.312=0.001
max23.322-23.321=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.066-0.064=0.002
σ0.002-0.003=-0.001
min0.064-0.059=0.005
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.495=-0.003
σ0.364-0.365=-0.002
min1756.920-1756.919=0.001
max1758.083-1758.083=-0.001
mean1669.000-1649.800=19.200
σ624.730-624.668=0.062
min663.000-638.000=25.000
max2692.000-2825.000=-133.000
mean2.363-2.369=-0.006
σ0.117-0.085=0.031
min2.139-2.286=-0.147
max2.735-2.641=0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.716-326.715=0.001
σ0.028-0.036=-0.008
min326.670-326.652=0.017
max326.740-326.744=-0.004
mean2692.000-2825.000=-133.000
σ0.000
min2692.000-2825.000=-133.000
max2692.000-2825.000=-133.000
mean0.427-0.423=0.005
σ0.004-0.001=0.003
min0.423-0.421=0.002
max0.433-0.424=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.877-1988.864=0.013
σ0.010-0.022=-0.012
min1988.865-1988.832=0.034
max1988.890-1988.881=0.010
mean2692.000-2825.000=-133.000
σ0.000
min2692.000-2825.000=-133.000
max2692.000-2825.000=-133.000
mean2.705-2.753=-0.048
σ0.090-0.262=-0.172
min2.638-2.579=0.060
max2.863-3.216=-0.353
iters=5
new-facts=6402
prior-facts=1
mean4813.601-4813.602=-0.000
σ7.784-7.785=-0.001
min4809.700-4809.714=-0.014
max4827.519-4827.522=-0.003
mean2692.000-2825.000=-133.000
σ0.000
min2692.000-2825.000=-133.000
max2692.000-2825.000=-133.000
mean8.757-8.580=0.177
σ0.163-0.314=-0.151
min8.594-8.125=0.469
max8.980-8.998=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean5001.202-5001.282=-0.081
σ0.151-0.037=0.114
min5000.933-5001.247=-0.314
max5001.293-5001.343=-0.050
mean3011.400-3037.400=-26.000
σ233.021-208.233=24.788
min2692.000-2825.000=-133.000
max3310.000-3303.000=7.000
mean9.813-9.737=0.076
σ0.083-0.400=-0.317
min9.702-9.165=0.537
max9.910-10.271=-0.362

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-0.982=0.096
σ0.222-0.066=0.157
min0.911-0.925=-0.014
max1.332-1.055=0.277

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.632-464.636=-0.005
σ574.781-574.771=0.010
min177.240-177.238=0.002
max1326.803-1326.793=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2692.000-2825.000=-133.000
σ0.000
min2692.000-2825.000=-133.000
max2692.000-2825.000=-133.000
mean0.557-0.434=0.124
σ0.569-0.307=0.262
min0.270-0.277=-0.007
max1.411-0.895=0.516
policies=20
mean1772.661-1772.706=-0.045
σ0.353-0.366=-0.013
min1772.417-1772.463=-0.046
max1773.184-1773.250=-0.065
mean840.000
σ0.000
min840.000
max840.000
mean2692.000-2825.000=-133.000
σ0.000
min2692.000-2825.000=-133.000
max2692.000-2825.000=-133.000
mean2.709-2.779=-0.070
σ0.016-0.005=0.011
min2.691-2.774=-0.084
max2.729-2.786=-0.056
policies=200
mean17733.909-17733.952=-0.043
σ0.400-0.092=0.308
min17733.503-17733.822=-0.319
max17734.455-17734.039=0.417
mean8400.000
σ0.000
min8400.000
max8400.000
mean2692.000-2825.000=-133.000
σ0.000
min2692.000-2825.000=-133.000
max2692.000-2825.000=-133.000
mean27.500-27.928=-0.428
σ0.170-0.352=-0.181
min27.352-27.587=-0.236
max27.684-28.345=-0.661