Compare commits

Home / Compare 004bf87d .. 43d19fa0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.001
σ0.053-0.053=0.001
min35.235-35.231=0.004
max35.413-35.409=0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.085-0.082=0.003
σ0.003-0.004=-0.001
min0.083-0.076=0.007
max0.091-0.089=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=0.000
min23.766-23.764=0.002
max23.774-23.773=0.001
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.067-0.067=0.000
σ0.003-0.005=-0.002
min0.063-0.061=0.002
max0.074-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.486=-0.002
σ0.364-0.367=-0.003
min1755.910-1755.909=0.001
max1757.068-1757.077=-0.009
mean1647.250-1647.300=-0.050
σ626.702-639.265=-12.563
min633.000-626.000=7.000
max2836.000-2824.000=12.000
mean2.382-2.314=0.068
σ0.103-0.103=-0.000
min2.089-2.100=-0.011
max2.581-2.552=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.707-324.709=-0.002
σ0.058-0.048=0.010
min324.604-324.624=-0.019
max324.741-324.739=0.002
mean2836.000-2824.000=12.000
σ0.000
min2836.000-2824.000=12.000
max2836.000-2824.000=12.000
mean0.433-0.423=0.010
σ0.011-0.001=0.010
min0.423-0.423=0.000
max0.448-0.424=0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.262=0.007
σ0.013-0.015=-0.002
min1985.250-1985.238=0.011
max1985.282-1985.278=0.004
mean2836.000-2824.000=12.000
σ0.000
min2836.000-2824.000=12.000
max2836.000-2824.000=12.000
mean2.685-2.677=0.007
σ0.169-0.113=0.056
min2.468-2.550=-0.082
max2.890-2.792=0.098
iters=5
new-facts=6402
prior-facts=1
mean4808.937-4808.861=0.076
σ7.784-7.669=0.115
min4804.924-4805.404=-0.480
max4822.850-4822.580=0.270
mean2836.000-2824.000=12.000
σ0.000
min2836.000-2824.000=12.000
max2836.000-2824.000=12.000
mean8.910-8.799=0.110
σ0.414-0.141=0.273
min8.212-8.614=-0.402
max9.308-8.931=0.377
iters=5
new-facts=6402
prior-facts=6402
mean4996.485-4996.466=0.018
σ0.148-0.021=0.127
min4996.229-4996.431=-0.202
max4996.584-4996.482=0.101
mean3071.600-3059.000=12.600
σ309.249-306.841=2.408
min2836.000-2824.000=12.000
max3550.000-3533.000=17.000
mean8.659-8.561=0.099
σ0.211-0.296=-0.085
min8.431-8.406=0.025
max8.896-9.089=-0.193

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.069-1.047=0.022
σ0.261-0.159=0.102
min0.919-0.895=0.024
max1.524-1.305=0.219

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.211-462.978=0.233
σ574.771-574.250=0.521
min175.818-175.842=-0.024
max1325.367-1324.353=1.015
mean86.250
σ8.500
min82.000
max99.000
mean2836.000-2824.000=12.000
σ0.000
min2836.000-2824.000=12.000
max2836.000-2824.000=12.000
mean0.433-0.430=0.002
σ0.302-0.296=0.006
min0.278-0.278=-0.000
max0.886-0.874=0.012
policies=20
mean1758.553-1758.716=-0.164
σ0.357-0.349=0.008
min1758.302-1758.478=-0.176
max1759.081-1759.233=-0.152
mean820.000
σ0.000
min820.000
max820.000
mean2836.000-2824.000=12.000
σ0.000
min2836.000-2824.000=12.000
max2836.000-2824.000=12.000
mean2.800-2.783=0.017
σ0.013-0.008=0.005
min2.787-2.773=0.014
max2.818-2.792=0.027
policies=200
mean17592.633-17593.349=-0.716
σ0.493-0.741=-0.249
min17592.200-17592.336=-0.136
max17593.342-17593.928=-0.586
mean8200.000
σ0.000
min8200.000
max8200.000
mean2836.000-2824.000=12.000
σ0.000
min2836.000-2824.000=12.000
max2836.000-2824.000=12.000
mean28.000-27.828=0.172
σ0.459-0.413=0.047
min27.547-27.433=0.114
max28.570-28.294=0.277