Compare commits

Home / Compare 6c9fb3a0 .. aabc52f4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-70.706=2.342
σ0.046-0.047=-0.000
min73.022-70.672=2.350
max73.178-70.836=2.342
mean412.100-417.000=-4.900
σ0.316-0.000=0.316
min412.000-417.000=-5.000
max413.000-417.000=-4.000
mean0.168-0.158=0.010
σ0.011-0.006=0.005
min0.153-0.150=0.003
max0.183-0.167=0.017
cache=y
dps=1
iters=10
policies=100
mean23.740-21.412=2.328
σ0.003-0.003=0.000
min23.735-21.407=2.327
max23.745-21.417=2.328
mean413.000-417.900=-4.900
σ0.000-0.316=-0.316
min413.000-417.000=-4.000
max413.000-418.000=-5.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.061-0.064=-0.002
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1754.929=3.859
σ0.363-0.358=0.005
min1758.214-1754.364=3.850
max1759.388-1755.502=3.886
mean1646.250-1649.250=-3.000
σ629.224-631.656=-2.433
min616.000-628.000=-12.000
max2770.000-2773.000=-3.000
mean2.827-2.804=0.024
σ0.163-0.194=-0.031
min2.372-2.371=0.001
max3.088-3.191=-0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean323.986-272.794=51.192
σ0.045-0.006=0.039
min323.905-272.783=51.122
max324.013-272.797=51.216
mean2770.000-2773.000=-3.000
σ0.000
min2770.000-2773.000=-3.000
max2770.000-2773.000=-3.000
mean0.429-0.381=0.047
σ0.006-0.009=-0.002
min0.425-0.373=0.051
max0.439-0.394=0.045
iters=5
new-facts=1
prior-facts=6402
mean1984.585-1933.229=51.356
σ0.018-0.009=0.009
min1984.553-1933.218=51.335
max1984.600-1933.241=51.359
mean2770.000-2773.000=-3.000
σ0.000
min2770.000-2773.000=-3.000
max2770.000-2773.000=-3.000
mean2.583-2.883=-0.301
σ0.076-0.276=-0.200
min2.471-2.416=0.055
max2.653-3.067=-0.414
iters=5
new-facts=6402
prior-facts=1
mean4808.238-4757.008=51.231
σ7.778-7.569=0.209
min4804.739-4753.543=51.196
max4822.152-4770.547=51.605
mean2770.000-2773.000=-3.000
σ0.000
min2770.000-2773.000=-3.000
max2770.000-2773.000=-3.000
mean9.006-8.159=0.847
σ0.086-0.477=-0.392
min8.918-7.674=1.244
max9.137-8.772=0.365
iters=5
new-facts=6402
prior-facts=6402
mean4995.809-4944.451=51.358
σ0.019-0.022=-0.003
min4995.788-4944.428=51.360
max4995.835-4944.484=51.351
mean2988.800-3017.600=-28.800
σ214.749-285.499=-70.750
min2770.000-2773.000=-3.000
max3305.000-3428.000=-123.000
mean8.670-8.497=0.173
σ0.166-0.109=0.056
min8.495-8.357=0.138
max8.910-8.652=0.258

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.035=-0.003
σ0.133-0.124=0.009
min0.913-0.915=-0.003
max1.240-1.221=0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.354-468.324=0.030
σ574.229-574.227=0.002
min181.231-181.200=0.031
max1329.697-1329.664=0.033
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2773.000=-3.000
σ0.000
min2770.000-2773.000=-3.000
max2770.000-2773.000=-3.000
mean0.444-0.443=0.000
σ0.304-0.304=-0.000
min0.289-0.288=0.001
max0.899-0.899=-0.000
policies=20
mean1812.634-1812.338=0.296
σ0.400-0.390=0.011
min1812.360-1812.058=0.302
max1813.224-1812.909=0.315
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2773.000=-3.000
σ0.000
min2770.000-2773.000=-3.000
max2770.000-2773.000=-3.000
mean2.888-2.884=0.004
σ0.025-0.026=-0.000
min2.866-2.865=0.001
max2.923-2.922=0.002
policies=200
mean18131.541-18128.991=2.550
σ0.344-0.483=-0.139
min18131.317-18128.681=2.635
max18132.046-18129.710=2.336
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2773.000=-3.000
σ0.000
min2770.000-2773.000=-3.000
max2770.000-2773.000=-3.000
mean28.386-28.322=0.064
σ0.128-0.171=-0.043
min28.247-28.223=0.025
max28.530-28.578=-0.048