Compare commits

Home / Compare cbbe86d6 .. a33902e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=0.000
σ0.052-0.053=-0.001
min35.216-35.218=-0.002
max35.389-35.393=-0.004
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.085-0.079=0.006
σ0.003-0.004=-0.000
min0.082-0.076=0.006
max0.092-0.087=0.005
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.003-0.003=0.000
min23.767-23.767=-0.001
max23.774-23.775=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.069-0.067=0.003
σ0.004-0.001=0.003
min0.066-0.066=0.001
max0.076-0.068=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.001
σ0.365-0.364=0.001
min1755.912-1755.911=0.001
max1757.072-1757.073=-0.000
mean1656.600-1650.550=6.050
σ638.599-628.062=10.537
min629.000-620.000=9.000
max2752.000-2693.000=59.000
mean2.321-2.356=-0.035
σ0.133-0.104=0.029
min2.105-2.220=-0.115
max2.778-2.649=0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.703=0.007
σ0.040-0.053=-0.013
min324.639-324.608=0.032
max324.736-324.729=0.007
mean2752.000-2693.000=59.000
σ0.000
min2752.000-2693.000=59.000
max2752.000-2693.000=59.000
mean0.425-0.428=-0.003
σ0.002-0.010=-0.008
min0.423-0.422=0.001
max0.428-0.445=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.256-1985.258=-0.002
σ0.016-0.011=0.004
min1985.239-1985.244=-0.005
max1985.273-1985.268=0.005
mean2752.000-2693.000=59.000
σ0.000
min2752.000-2693.000=59.000
max2752.000-2693.000=59.000
mean2.671-2.639=0.032
σ0.098-0.095=0.004
min2.575-2.575=-0.000
max2.799-2.796=0.003
iters=5
new-facts=6402
prior-facts=1
mean4808.876-4808.877=-0.000
σ7.654-7.687=-0.033
min4805.381-4805.364=0.017
max4822.569-4822.628=-0.059
mean2752.000-2693.000=59.000
σ0.000
min2752.000-2693.000=59.000
max2752.000-2693.000=59.000
mean8.992-8.984=0.008
σ0.163-0.241=-0.078
min8.747-8.670=0.077
max9.189-9.301=-0.112
iters=5
new-facts=6402
prior-facts=6402
mean4996.462-4996.466=-0.003
σ0.014-0.009=0.004
min4996.447-4996.451=-0.004
max4996.476-4996.474=0.001
mean3038.200-3007.400=30.800
σ341.750-361.672=-19.922
min2752.000-2693.000=59.000
max3544.000-3535.000=9.000
mean8.688-8.645=0.043
σ0.336-0.138=0.198
min8.446-8.473=-0.027
max9.257-8.793=0.465

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.941-0.941=-0.000
σ0.058-0.062=-0.004
min0.909-0.900=0.009
max1.044-1.048=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.967-462.958=0.009
σ574.246-574.254=-0.009
min175.840-175.817=0.023
max1324.336-1324.340=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2752.000-2693.000=59.000
σ0.000
min2752.000-2693.000=59.000
max2752.000-2693.000=59.000
mean0.440-0.551=-0.111
σ0.302-0.554=-0.252
min0.285-0.274=0.011
max0.894-1.382=-0.489
policies=20
mean1758.686-1758.533=0.153
σ0.302-0.336=-0.034
min1758.490-1758.308=0.182
max1759.133-1759.032=0.101
mean820.000
σ0.000
min820.000
max820.000
mean2752.000-2693.000=59.000
σ0.000
min2752.000-2693.000=59.000
max2752.000-2693.000=59.000
mean2.847-2.719=0.128
σ0.058-0.006=0.052
min2.806-2.712=0.094
max2.934-2.726=0.207
policies=200
mean17592.412-17592.443=-0.031
σ0.561-0.484=0.078
min17591.914-17592.173=-0.258
max17593.211-17593.167=0.043
mean8200.000
σ0.000
min8200.000
max8200.000
mean2752.000-2693.000=59.000
σ0.000
min2752.000-2693.000=59.000
max2752.000-2693.000=59.000
mean27.573-27.449=0.124
σ0.224-0.073=0.151
min27.366-27.364=0.002
max27.874-27.529=0.345