Compare commits

Home / Compare 69b10016 .. 042728c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.388=0.005
σ0.044-0.044=-0.000
min70.369-70.362=0.007
max70.515-70.510=0.006
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.157-0.159=-0.001
σ0.004-0.003=0.001
min0.150-0.155=-0.005
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.147-21.144=0.003
σ0.011-0.003=0.008
min21.139-21.140=-0.000
max21.177-21.150=0.027
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.062-0.064=-0.002
σ0.004-0.002=0.001
min0.059-0.062=-0.003
max0.070-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.701-1752.395=0.305
σ0.360-0.362=-0.002
min1752.126-1751.824=0.302
max1753.286-1752.984=0.302
mean1655.900-1649.450=6.450
σ631.153-627.418=3.735
min618.000-619.000=-1.000
max2771.000-2662.000=109.000
mean2.842-2.849=-0.007
σ0.109-0.133=-0.024
min2.558-2.584=-0.025
max3.028-3.074=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.608-270.141=0.467
σ0.007-0.007=0.001
min270.598-270.135=0.463
max270.616-270.152=0.465
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean0.379-0.377=0.002
σ0.006-0.003=0.003
min0.371-0.372=-0.001
max0.385-0.379=0.007
iters=5
new-facts=1
prior-facts=6402
mean1931.042-1930.597=0.445
σ0.018-0.017=0.001
min1931.025-1930.573=0.452
max1931.071-1930.618=0.453
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean2.866-2.567=0.299
σ0.225-0.121=0.105
min2.489-2.434=0.055
max3.075-2.721=0.353
iters=5
new-facts=6402
prior-facts=1
mean4751.733-4751.127=0.606
σ0.924-0.754=0.170
min4751.253-4750.344=0.909
max4753.384-4752.372=1.011
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean8.665-8.266=0.399
σ0.512-0.515=-0.003
min7.821-7.660=0.161
max9.093-8.932=0.161
iters=5
new-facts=6402
prior-facts=6402
mean4942.240-4941.696=0.544
σ0.023-0.163=-0.140
min4942.217-4941.409=0.808
max4942.268-4941.795=0.473
mean3030.600-2996.600=34.000
σ236.158-363.796=-127.637
min2771.000-2662.000=109.000
max3331.000-3511.000=-180.000
mean8.641-8.584=0.058
σ0.194-0.352=-0.158
min8.417-8.304=0.113
max8.828-9.176=-0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.132-1.156=-0.025
σ0.094-0.323=-0.230
min1.062-0.931=0.131
max1.244-1.640=-0.396

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.212-466.378=0.834
σ575.943-575.951=-0.008
min179.229-178.399=0.830
max1331.127-1330.305=0.822
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean0.470-0.554=-0.083
σ0.389-0.548=-0.158
min0.264-0.277=-0.012
max1.054-1.375=-0.321
policies=20
mean1792.622-1784.322=8.300
σ0.372-0.348=0.024
min1792.367-1784.095=8.272
max1793.175-1784.839=8.336
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean2.779-2.816=-0.036
σ0.011-0.046=-0.035
min2.768-2.772=-0.003
max2.793-2.877=-0.084
policies=200
mean17932.923-17849.742=83.181
σ0.583-0.518=0.065
min17932.604-17849.436=83.167
max17933.797-17850.517=83.280
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean27.963-28.063=-0.100
σ0.133-0.171=-0.037
min27.871-27.953=-0.082
max28.160-28.316=-0.156