Compare commits

Home / Compare 91559296 .. bce51980

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.388=0.173
σ0.045-0.045=-0.001
min70.539-70.359=0.181
max70.687-70.513=0.174
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.160-0.156=0.004
σ0.004-0.005=-0.001
min0.154-0.150=0.005
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.144=0.143
σ0.004-0.003=0.001
min21.281-21.139=0.141
max21.295-21.148=0.146
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.063-0.062=0.001
σ0.003-0.004=-0.000
min0.059-0.058=0.001
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1714.484=38.890
σ0.360-169.603=-169.242
min1752.804-993.924=758.880
max1753.961-1752.973=0.988
mean1648.650-1614.150=34.500
σ639.110-613.525=25.585
min626.000-617.000=9.000
max2843.000-2773.000=70.000
mean2.808-2.819=-0.011
σ0.146-0.339=-0.193
min2.329-1.511=0.819
max2.979-3.290=-0.311

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.759-270.145=1.615
σ0.005-0.008=-0.003
min271.752-270.136=1.616
max271.765-270.154=1.611
mean2843.000-2773.000=70.000
σ0.000
min2843.000-2773.000=70.000
max2843.000-2773.000=70.000
mean0.381-0.378=0.003
σ0.005-0.006=-0.001
min0.376-0.368=0.008
max0.390-0.387=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1930.610=1.569
σ0.006-0.008=-0.002
min1932.169-1930.600=1.568
max1932.182-1930.620=1.562
mean2843.000-2773.000=70.000
σ0.000
min2843.000-2773.000=70.000
max2843.000-2773.000=70.000
mean3.063-2.531=0.532
σ0.128-0.090=0.038
min2.923-2.465=0.459
max3.256-2.643=0.613
iters=5
new-facts=6402
prior-facts=1
mean4752.959-4751.311=1.649
σ0.801-0.911=-0.110
min4752.370-4750.799=1.570
max4754.369-4752.930=1.439
mean2843.000-2773.000=70.000
σ0.000
min2843.000-2773.000=70.000
max2843.000-2773.000=70.000
mean8.196-8.558=-0.362
σ0.566-0.566=0.000
min7.786-7.654=0.132
max9.182-9.078=0.104
iters=5
new-facts=6402
prior-facts=6402
mean4943.378-4941.702=1.676
σ0.017-0.164=-0.147
min4943.358-4941.410=1.949
max4943.396-4941.800=1.596
mean3047.200-3043.400=3.800
σ278.963-233.773=45.190
min2843.000-2773.000=70.000
max3476.000-3370.000=106.000
mean8.616-8.604=0.011
σ0.164-0.331=-0.167
min8.454-8.346=0.108
max8.813-9.002=-0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.065-1.023=0.042
σ0.122-0.142=-0.020
min0.949-0.929=0.021
max1.254-1.256=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.867-466.373=1.494
σ575.934-575.927=0.007
min179.889-178.399=1.490
max1331.768-1330.264=1.505
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2843.000-2773.000=70.000
σ0.000
min2843.000-2773.000=70.000
max2843.000-2773.000=70.000
mean0.446-0.441=0.005
σ0.307-0.302=0.006
min0.289-0.288=0.001
max0.907-0.894=0.014
policies=20
mean1799.188-1784.353=14.835
σ0.380-0.368=0.012
min1798.926-1784.103=14.823
max1799.747-1784.895=14.851
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2843.000-2773.000=70.000
σ0.000
min2843.000-2773.000=70.000
max2843.000-2773.000=70.000
mean2.895-2.863=0.032
σ0.003-0.008=-0.005
min2.891-2.854=0.037
max2.898-2.872=0.027
policies=200
mean17998.500-17849.919=148.581
σ0.465-0.507=-0.042
min17998.227-17849.583=148.644
max17999.195-17850.674=148.521
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2843.000-2773.000=70.000
σ0.000
min2843.000-2773.000=70.000
max2843.000-2773.000=70.000
mean28.688-28.211=0.477
σ0.478-0.426=0.053
min28.275-27.904=0.371
max29.186-28.808=0.378