Compare commits

Home / Compare 1427d704 .. 8a2c0bed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.272-35.264=0.009
σ0.053-0.056=-0.003
min35.243-35.233=0.010
max35.422-35.422=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.002
min0.076-0.083=-0.007
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.777-23.769=0.008
σ0.002-0.002=-0.000
min23.773-23.765=0.008
max23.779-23.773=0.007
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.067=-0.004
σ0.004-0.005=-0.001
min0.061-0.062=-0.001
max0.071-0.075=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.486=0.000
σ0.365-0.364=0.001
min1755.914-1755.910=0.003
max1757.083-1757.069=0.014
mean1641.300-1651.250=-9.950
σ625.688-643.280=-17.593
min632.000-625.000=7.000
max2829.000-2838.000=-9.000
mean2.347-2.341=0.006
σ0.109-0.084=0.025
min2.246-2.266=-0.020
max2.740-2.539=0.201

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.710-324.705=0.004
σ0.059-0.055=0.004
min324.605-324.609=-0.004
max324.743-324.739=0.004
mean2829.000-2838.000=-9.000
σ0.000
min2829.000-2838.000=-9.000
max2829.000-2838.000=-9.000
mean0.439-0.429=0.010
σ0.010-0.009=0.001
min0.423-0.421=0.003
max0.448-0.444=0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.273-1985.259=0.014
σ0.007-0.018=-0.011
min1985.266-1985.241=0.026
max1985.286-1985.279=0.007
mean2829.000-2838.000=-9.000
σ0.000
min2829.000-2838.000=-9.000
max2829.000-2838.000=-9.000
mean2.551-2.698=-0.147
σ0.100-0.255=-0.155
min2.416-2.530=-0.114
max2.655-3.142=-0.486
iters=5
new-facts=6402
prior-facts=1
mean4808.883-4808.675=0.208
σ7.738-7.844=-0.106
min4805.375-4804.228=1.147
max4822.724-4822.671=0.054
mean2829.000-2838.000=-9.000
σ0.000
min2829.000-2838.000=-9.000
max2829.000-2838.000=-9.000
mean8.961-8.747=0.215
σ0.212-0.522=-0.310
min8.687-7.844=0.843
max9.270-9.197=0.073
iters=5
new-facts=6402
prior-facts=6402
mean4996.336-4996.469=-0.133
σ0.193-0.017=0.176
min4996.105-4996.449=-0.343
max4996.485-4996.488=-0.003
mean3056.800-3037.200=19.600
σ212.334-278.309=-65.975
min2829.000-2838.000=-9.000
max3367.000-3477.000=-110.000
mean8.707-8.521=0.186
σ0.197-0.104=0.093
min8.473-8.449=0.023
max8.918-8.702=0.216

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.977-1.058=-0.081
σ0.066-0.112=-0.046
min0.922-0.916=0.006
max1.050-1.229=-0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.960-462.974=-0.013
σ574.255-574.254=0.001
min175.824-175.837=-0.013
max1324.342-1324.354=-0.011
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2838.000=-9.000
σ0.000
min2829.000-2838.000=-9.000
max2829.000-2838.000=-9.000
mean0.434-0.432=0.002
σ0.303-0.298=0.005
min0.281-0.280=0.001
max0.889-0.879=0.010
policies=20
mean1758.580-1758.714=-0.134
σ0.351-0.353=-0.002
min1758.331-1758.476=-0.145
max1759.098-1759.238=-0.140
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2838.000=-9.000
σ0.000
min2829.000-2838.000=-9.000
max2829.000-2838.000=-9.000
mean2.791-2.786=0.006
σ0.004-0.011=-0.006
min2.789-2.770=0.018
max2.798-2.794=0.004
policies=200
mean17592.534-17593.405=-0.871
σ0.464-0.594=-0.130
min17592.035-17592.743=-0.707
max17593.157-17593.963=-0.806
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2838.000=-9.000
σ0.000
min2829.000-2838.000=-9.000
max2829.000-2838.000=-9.000
mean27.876-27.889=-0.013
σ0.366-0.304=0.062
min27.571-27.547=0.024
max28.330-28.228=0.102