Compare commits

Home / Compare 1ffe200e .. 004bf87d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.053-0.055=-0.002
min35.231-35.231=-0.001
max35.409-35.416=-0.007
mean413.000-414.600=-1.600
σ0.000-0.516=-0.516
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.082-0.085=-0.003
σ0.004-0.004=0.000
min0.076-0.081=-0.005
max0.089-0.092=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=0.000
min23.764
max23.773-23.774=-0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.067-0.066=0.000
σ0.005-0.004=0.001
min0.061-0.061=-0.001
max0.074-0.073=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.001
σ0.367-0.365=0.001
min1755.909-1755.910=-0.002
max1757.077-1757.085=-0.008
mean1647.300-1649.750=-2.450
σ639.265-644.632=-5.366
min626.000-643.000=-17.000
max2824.000-2840.000=-16.000
mean2.314-2.329=-0.015
σ0.103-0.098=0.005
min2.100-2.151=-0.051
max2.552-2.597=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-324.713=-0.004
σ0.048-0.038=0.010
min324.624-324.646=-0.022
max324.739-324.737=0.002
mean2824.000-2840.000=-16.000
σ0.000
min2824.000-2840.000=-16.000
max2824.000-2840.000=-16.000
mean0.423-0.424=-0.000
σ0.001-0.001=-0.001
min0.423-0.422=0.000
max0.424-0.426=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.273=-0.011
σ0.015-0.007=0.008
min1985.238-1985.267=-0.029
max1985.278-1985.285=-0.007
mean2824.000-2840.000=-16.000
σ0.000
min2824.000-2840.000=-16.000
max2824.000-2840.000=-16.000
mean2.677-2.617=0.060
σ0.113-0.084=0.029
min2.550-2.553=-0.002
max2.792-2.728=0.063
iters=5
new-facts=6402
prior-facts=1
mean4808.861-4808.863=-0.003
σ7.669-7.653=0.016
min4805.404-4805.387=0.018
max4822.580-4822.554=0.026
mean2824.000-2840.000=-16.000
σ0.000
min2824.000-2840.000=-16.000
max2824.000-2840.000=-16.000
mean8.799-8.926=-0.127
σ0.141-0.201=-0.060
min8.614-8.636=-0.022
max8.931-9.136=-0.205
iters=5
new-facts=6402
prior-facts=6402
mean4996.466-4996.465=0.001
σ0.021-0.019=0.002
min4996.431-4996.445=-0.013
max4996.482-4996.490=-0.008
mean3059.000-3041.400=17.600
σ306.841-211.079=95.762
min2824.000-2840.000=-16.000
max3533.000-3345.000=188.000
mean8.561-8.641=-0.081
σ0.296-0.183=0.113
min8.406-8.493=-0.087
max9.089-8.935=0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.006=0.040
σ0.159-0.064=0.095
min0.895-0.920=-0.025
max1.305-1.059=0.246

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-462.968=0.010
σ574.250-574.252=-0.002
min175.842-175.836=0.006
max1324.353-1324.346=0.006
mean86.250
σ8.500
min82.000
max99.000
mean2824.000-2840.000=-16.000
σ0.000
min2824.000-2840.000=-16.000
max2824.000-2840.000=-16.000
mean0.430-0.464=-0.034
σ0.296-0.368=-0.072
min0.278-0.278=0.001
max0.874-1.016=-0.142
policies=20
mean1758.716-1758.714=0.003
σ0.349-0.357=-0.007
min1758.478-1758.464=0.014
max1759.233-1759.242=-0.008
mean820.000
σ0.000
min820.000
max820.000
mean2824.000-2840.000=-16.000
σ0.000
min2824.000-2840.000=-16.000
max2824.000-2840.000=-16.000
mean2.783-2.782=0.001
σ0.008-0.019=-0.011
min2.773-2.754=0.019
max2.792-2.794=-0.002
policies=200
mean17593.349-17593.365=-0.016
σ0.741-0.631=0.111
min17592.336-17592.632=-0.296
max17593.928-17593.900=0.028
mean8200.000
σ0.000
min8200.000
max8200.000
mean2824.000-2840.000=-16.000
σ0.000
min2824.000-2840.000=-16.000
max2824.000-2840.000=-16.000
mean27.828-27.936=-0.108
σ0.413-0.367=0.045
min27.433-27.583=-0.150
max28.294-28.410=-0.117