Compare commits

Home / Compare 87d48c2a .. 537c09c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.619=-0.001
σ0.054-0.054=-0.001
min35.590-35.592=-0.002
max35.770-35.772=-0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.083-0.086=-0.003
σ0.005-0.003=0.001
min0.076-0.083=-0.007
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.002
σ0.003-0.003=0.000
min24.044-24.042=0.002
max24.054-24.053=0.001
mean414.000-413.600=0.400
σ0.000-0.516=-0.516
min414.000-413.000=1.000
max414.000
mean0.069-0.066=0.004
σ0.003-0.005=-0.001
min0.067-0.062=0.005
max0.076-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.492-1756.491=0.001
σ0.366-0.364=0.001
min1755.919-1755.918=0.001
max1757.078-1757.082=-0.004
mean1648.250-1654.150=-5.900
σ633.167-637.067=-3.900
min622.000-689.000=-67.000
max2830.000-2840.000=-10.000
mean2.326-2.346=-0.020
σ0.103-0.083=0.020
min2.072-2.204=-0.132
max2.497-2.503=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.778-324.761=0.017
σ0.033-0.055=-0.022
min324.722-324.664=0.057
max324.807-324.797=0.010
mean2830.000-2840.000=-10.000
σ0.000
min2830.000-2840.000=-10.000
max2830.000-2840.000=-10.000
mean0.423-0.425=-0.002
σ0.001-0.003=-0.002
min0.422-0.423=-0.001
max0.425-0.430=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.323-1985.319=0.004
σ0.015-0.017=-0.002
min1985.306-1985.298=0.008
max1985.337-1985.338=-0.001
mean2830.000-2840.000=-10.000
σ0.000
min2830.000-2840.000=-10.000
max2830.000-2840.000=-10.000
mean2.621-2.731=-0.110
σ0.054-0.108=-0.054
min2.573-2.616=-0.043
max2.690-2.834=-0.145
iters=5
new-facts=6402
prior-facts=1
mean4808.808-4808.855=-0.047
σ7.790-7.788=0.003
min4804.837-4804.898=-0.061
max4822.735-4822.776=-0.042
mean2830.000-2840.000=-10.000
σ0.000
min2830.000-2840.000=-10.000
max2830.000-2840.000=-10.000
mean8.712-8.711=0.002
σ0.264-0.613=-0.349
min8.342-7.744=0.597
max9.044-9.295=-0.251
iters=5
new-facts=6402
prior-facts=6402
mean4996.530-4996.457=0.073
σ0.025-0.171=-0.146
min4996.504-4996.152=0.352
max4996.563-4996.549=0.013
mean3034.200-3050.200=-16.000
σ280.479-273.042=7.437
min2830.000-2840.000=-10.000
max3475.000-3471.000=4.000
mean8.489-8.574=-0.085
σ0.150-0.108=0.042
min8.370-8.506=-0.136
max8.750-8.758=-0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-0.943=0.000
σ0.056-0.061=-0.004
min0.910-0.901=0.010
max1.041-1.050=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.948=-0.001
σ574.251-574.248=0.002
min175.819-175.818=0.001
max1324.323-1324.321=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2830.000-2840.000=-10.000
σ0.000
min2830.000-2840.000=-10.000
max2830.000-2840.000=-10.000
mean0.426-0.434=-0.009
σ0.294-0.301=-0.007
min0.276-0.284=-0.008
max0.867-0.885=-0.019
policies=20
mean1758.523-1758.502=0.021
σ0.340-0.337=0.002
min1758.315-1758.289=0.026
max1759.030-1759.004=0.026
mean820.000
σ0.000
min820.000
max820.000
mean2830.000-2840.000=-10.000
σ0.000
min2830.000-2840.000=-10.000
max2830.000-2840.000=-10.000
mean2.791-2.794=-0.003
σ0.012-0.009=0.003
min2.781-2.784=-0.003
max2.807-2.803=0.004
policies=200
mean17591.973-17592.056=-0.084
σ0.546-0.484=0.062
min17591.663-17591.694=-0.030
max17592.790-17592.767=0.023
mean8200.000
σ0.000
min8200.000
max8200.000
mean2830.000-2840.000=-10.000
σ0.000
min2830.000-2840.000=-10.000
max2830.000-2840.000=-10.000
mean27.773-27.820=-0.048
σ0.392-0.335=0.057
min27.360-27.452=-0.091
max28.176-28.197=-0.020