Compare commits

Home / Compare dd655792 .. cdc7036a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.706-70.707=-0.002
σ0.045-0.047=-0.002
min70.679-70.673=0.006
max70.830-70.835=-0.005
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.156-0.163=-0.007
σ0.005-0.005=0.000
min0.150-0.158=-0.009
max0.162-0.172=-0.010
cache=y
dps=1
iters=10
policies=100
mean21.410-21.411=-0.001
σ0.002-0.003=-0.000
min21.407-21.407=-0.001
max21.413-21.417=-0.004
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.063-0.065=-0.003
σ0.003-0.002=0.001
min0.059-0.064=-0.005
max0.068-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.932=-0.001
σ0.359-0.360=-0.001
min1754.365-1754.366=-0.001
max1755.511-1755.507=0.004
mean1665.550-1661.500=4.050
σ644.345-618.479=25.867
min620.000-621.000=-1.000
max2737.000-2490.000=247.000
mean2.859-2.804=0.055
σ0.132-0.160=-0.028
min2.503-2.344=0.158
max3.114-3.028=0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.758-272.754=0.003
σ0.005-0.007=-0.002
min272.751-272.746=0.004
max272.764-272.765=-0.001
mean2737.000-2490.000=247.000
σ0.000
min2737.000-2490.000=247.000
max2737.000-2490.000=247.000
mean0.383-0.384=-0.001
σ0.006-0.009=-0.003
min0.379-0.377=0.002
max0.391-0.395=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.157-1933.163=-0.005
σ0.015-0.017=-0.002
min1933.138-1933.141=-0.003
max1933.180-1933.180=-0.001
mean2737.000-2490.000=247.000
σ0.000
min2737.000-2490.000=247.000
max2737.000-2490.000=247.000
mean3.130-3.046=0.085
σ0.142-0.411=-0.269
min3.002-2.452=0.549
max3.356-3.612=-0.256
iters=5
new-facts=6402
prior-facts=1
mean4756.876-4756.925=-0.049
σ7.599-7.527=0.072
min4753.384-4753.455=-0.071
max4770.468-4770.389=0.080
mean2737.000-2490.000=247.000
σ0.000
min2737.000-2490.000=247.000
max2737.000-2490.000=247.000
mean8.724-8.524=0.200
σ0.295-0.263=0.033
min8.380-8.219=0.161
max9.056-8.895=0.161
iters=5
new-facts=6402
prior-facts=6402
mean4944.384-4944.248=0.136
σ0.019-0.324=-0.304
min4944.363-4943.670=0.693
max4944.405-4944.416=-0.011
mean3020.400-2907.200=113.200
σ334.238-364.363=-30.125
min2737.000-2490.000=247.000
max3515.000-3404.000=111.000
mean8.405-8.435=-0.031
σ0.133-0.119=0.014
min8.311-8.285=0.025
max8.636-8.616=0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-1.550=-0.536
σ0.133-0.196=-0.063
min0.927-1.232=-0.305
max1.231-1.717=-0.486

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.343-468.321=0.022
σ574.295-574.261=0.034
min181.187-181.188=-0.000
max1329.785-1329.712=0.072
mean88.250
σ8.500
min84.000
max101.000
mean2737.000-2490.000=247.000
σ0.000
min2737.000-2490.000=247.000
max2737.000-2490.000=247.000
mean0.604-0.562=0.042
σ0.635-0.553=0.082
min0.284-0.285=-0.001
max1.556-1.392=0.164
policies=20
mean1812.174-1812.186=-0.012
σ0.385-0.388=-0.003
min1811.912-1811.921=-0.009
max1812.743-1812.760=-0.017
mean840.000
σ0.000
min840.000
max840.000
mean2737.000-2490.000=247.000
σ0.000
min2737.000-2490.000=247.000
max2737.000-2490.000=247.000
mean2.830-2.811=0.019
σ0.029-0.009=0.020
min2.804-2.802=0.002
max2.869-2.820=0.049
policies=200
mean18129.189-18129.040=0.149
σ0.504-0.404=0.100
min18128.870-18128.708=0.162
max18129.940-18129.627=0.313
mean8400.000
σ0.000
min8400.000
max8400.000
mean2737.000-2490.000=247.000
σ0.000
min2737.000-2490.000=247.000
max2737.000-2490.000=247.000
mean28.385-28.347=0.038
σ0.060-0.019=0.042
min28.298-28.321=-0.023
max28.434-28.364=0.070