Compare commits

Home / Compare 2176346c .. 90306348

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.784-70.782=0.002
σ0.045-0.046=-0.001
min70.753-70.751=0.002
max70.909-70.911=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.165-0.160=0.005
σ0.010-0.005=0.005
min0.157-0.149=0.008
max0.187-0.168=0.019
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.000
σ0.003-0.002=0.001
min21.487-21.489=-0.001
max21.499-21.495=0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.061-0.063=-0.002
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1716.183=37.910
σ0.362-169.660=-169.298
min1753.529-995.379=758.150
max1754.684-1754.680=0.004
mean1661.300-1607.200=54.100
σ633.756-644.241=-10.485
min626.000-627.000=-1.000
max2780.000-2698.000=82.000
mean2.785-2.688=0.097
σ0.197-0.369=-0.172
min2.102-1.460=0.642
max3.093-3.039=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.948=0.007
σ0.009-0.008=0.001
min271.949-271.942=0.007
max271.970-271.962=0.008
mean2780.000-2698.000=82.000
σ0.000
min2780.000-2698.000=82.000
max2780.000-2698.000=82.000
mean0.385-0.379=0.006
σ0.012-0.002=0.010
min0.376-0.377=-0.000
max0.406-0.382=0.024
iters=5
new-facts=1
prior-facts=6402
mean1932.330-1932.328=0.002
σ0.005-0.022=-0.017
min1932.326-1932.301=0.025
max1932.338-1932.361=-0.022
mean2780.000-2698.000=82.000
σ0.000
min2780.000-2698.000=82.000
max2780.000-2698.000=82.000
mean2.905-2.932=-0.027
σ0.355-0.312=0.043
min2.275-2.382=-0.106
max3.120-3.123=-0.004
iters=5
new-facts=6402
prior-facts=1
mean4753.138-4753.074=0.063
σ0.925-0.913=0.011
min4752.531-4752.578=-0.047
max4754.775-4754.699=0.076
mean2780.000-2698.000=82.000
σ0.000
min2780.000-2698.000=82.000
max2780.000-2698.000=82.000
mean8.308-8.621=-0.312
σ0.629-0.418=0.211
min7.749-8.055=-0.305
max9.282-8.997=0.285
iters=5
new-facts=6402
prior-facts=6402
mean4943.558-4943.558=0.000
σ0.023-0.014=0.009
min4943.532-4943.541=-0.008
max4943.580-4943.573=0.007
mean3052.800-2944.200=108.600
σ335.428-246.016=89.412
min2780.000-2698.000=82.000
max3560.000-3320.000=240.000
mean8.503-8.529=-0.025
σ0.137-0.212=-0.075
min8.356-8.365=-0.010
max8.643-8.868=-0.225

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.066-1.120=-0.054
σ0.170-0.265=-0.094
min0.927-0.939=-0.011
max1.347-1.528=-0.181

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.637-468.643=-0.006
σ574.936-574.936=-0.000
min181.163-181.167=-0.003
max1331.041-1331.047=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2780.000-2698.000=82.000
σ0.000
min2780.000-2698.000=82.000
max2780.000-2698.000=82.000
mean0.448-0.575=-0.128
σ0.305-0.561=-0.256
min0.292-0.287=0.004
max0.906-1.417=-0.512
policies=20
mean1812.002-1811.953=0.049
σ0.370-0.376=-0.006
min1811.734-1811.715=0.018
max1812.536-1812.512=0.024
mean840.000
σ0.000
min840.000
max840.000
mean2780.000-2698.000=82.000
σ0.000
min2780.000-2698.000=82.000
max2780.000-2698.000=82.000
mean2.925-2.826=0.100
σ0.075-0.020=0.054
min2.839-2.801=0.038
max3.021-2.845=0.176
policies=200
mean18126.799-18126.815=-0.016
σ0.539-0.510=0.029
min18126.465-18126.534=-0.069
max18127.604-18127.580=0.025
mean8400.000
σ0.000
min8400.000
max8400.000
mean2780.000-2698.000=82.000
σ0.000
min2780.000-2698.000=82.000
max2780.000-2698.000=82.000
mean28.429-28.487=-0.058
σ0.037-0.114=-0.077
min28.388-28.387=0.002
max28.477-28.650=-0.173