Compare commits

Home / Compare afcec8df .. bd3cacb8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.704=-0.000
σ0.049-0.047=0.002
min70.667-70.671=-0.004
max70.838-70.833=0.005
mean414.000-413.100=0.900
σ0.000-0.316=-0.316
min414.000-413.000=1.000
max414.000
mean0.161-0.163=-0.002
σ0.003-0.004=-0.000
min0.159-0.158=0.001
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=-0.000
σ0.003-0.003=-0.000
min21.401-21.402=-0.001
max21.411-21.411=-0.000
mean414.500-414.000=0.500
σ0.527-0.000=0.527
min414.000
max415.000-414.000=1.000
mean0.063-0.063=-0.001
σ0.004-0.003=0.001
min0.059-0.060=-0.001
max0.069-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.930=-0.001
σ0.362-0.361=0.001
min1754.357-1754.355=0.002
max1755.512-1755.497=0.015
mean1660.650-1647.150=13.500
σ646.005-632.688=13.318
min623.000
max2779.000-2773.000=6.000
mean2.782-2.751=0.031
σ0.179-0.241=-0.062
min2.248-2.142=0.106
max2.978-3.016=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.757=-0.000
σ0.006-0.007=-0.001
min272.750-272.748=0.002
max272.764-272.765=-0.001
mean2779.000-2773.000=6.000
σ0.000
min2779.000-2773.000=6.000
max2779.000-2773.000=6.000
mean0.383-0.381=0.002
σ0.008-0.008=-0.000
min0.378-0.377=0.001
max0.397-0.395=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.168-1933.159=0.009
σ0.015-0.015=-0.000
min1933.145-1933.146=-0.001
max1933.181-1933.176=0.005
mean2779.000-2773.000=6.000
σ0.000
min2779.000-2773.000=6.000
max2779.000-2773.000=6.000
mean3.057-3.057=0.000
σ0.054-0.051=0.003
min3.019-3.008=0.010
max3.152-3.123=0.029
iters=5
new-facts=6402
prior-facts=1
mean4756.923-4756.922=0.001
σ7.561-7.579=-0.017
min4753.485-4753.391=0.094
max4770.449-4770.477=-0.029
mean2779.000-2773.000=6.000
σ0.000
min2779.000-2773.000=6.000
max2779.000-2773.000=6.000
mean8.436-8.742=-0.306
σ0.400-0.432=-0.033
min7.837-8.340=-0.503
max8.909-9.459=-0.550
iters=5
new-facts=6402
prior-facts=6402
mean4944.325-4944.322=0.002
σ0.146-0.164=-0.018
min4944.065-4944.031=0.034
max4944.406-4944.409=-0.003
mean3038.200-2996.800=41.400
σ315.303-282.298=33.004
min2779.000-2773.000=6.000
max3512.000-3420.000=92.000
mean8.496-8.442=0.054
σ0.114-0.096=0.018
min8.414-8.302=0.112
max8.690-8.549=0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-1.122=-0.119
σ0.134-0.248=-0.114
min0.914-0.918=-0.003
max1.220-1.504=-0.283

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.339-468.341=-0.002
σ574.257-574.255=0.001
min181.203-181.205=-0.002
max1329.724-1329.724=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2779.000-2773.000=6.000
σ0.000
min2779.000-2773.000=6.000
max2779.000-2773.000=6.000
mean0.446-0.442=0.003
σ0.301-0.301=-0.001
min0.291-0.286=0.005
max0.896-0.894=0.002
policies=20
mean1812.370-1812.353=0.017
σ0.395-0.393=0.002
min1812.090-1812.083=0.006
max1812.948-1812.932=0.016
mean840.000
σ0.000
min840.000
max840.000
mean2779.000-2773.000=6.000
σ0.000
min2779.000-2773.000=6.000
max2779.000-2773.000=6.000
mean2.886-2.894=-0.008
σ0.006-0.012=-0.006
min2.877-2.884=-0.007
max2.890-2.911=-0.021
policies=200
mean18129.090-18128.941=0.149
σ0.526-0.397=0.129
min18128.626-18128.565=0.061
max18129.577-18129.472=0.105
mean8400.000
σ0.000
min8400.000
max8400.000
mean2779.000-2773.000=6.000
σ0.000
min2779.000-2773.000=6.000
max2779.000-2773.000=6.000
mean28.545-28.461=0.083
σ0.238-0.253=-0.015
min28.328-28.284=0.044
max28.884-28.832=0.051