Compare commits

Home / Compare fb91bdce .. dd5e34b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.048-70.782=2.266
σ0.046-0.046=0.000
min73.022-70.751=2.271
max73.178-70.909=2.269
mean412.100-414.000=-1.900
σ0.316-0.000=0.316
min412.000-414.000=-2.000
max413.000-414.000=-1.000
mean0.168-0.158=0.010
σ0.011-0.006=0.006
min0.153-0.150=0.003
max0.183-0.167=0.016
cache=y
dps=1
iters=10
policies=100
mean23.740-21.492=2.248
σ0.003-0.002=0.002
min23.735-21.489=2.245
max23.745-21.495=2.250
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.063=0.003
σ0.003-0.003=-0.000
min0.061-0.060=0.002
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.789-1754.093=4.696
σ0.363-0.361=0.001
min1758.214-1753.522=4.692
max1759.388-1754.673=4.715
mean1646.250-1652.850=-6.600
σ629.224-629.845=-0.621
min616.000-623.000=-7.000
max2770.000-2702.000=68.000
mean2.827-2.773=0.055
σ0.163-0.206=-0.043
min2.372-2.260=0.111
max3.088-2.982=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean323.986-271.599=52.386
σ0.045-0.007=0.038
min323.905-271.591=52.314
max324.013-271.607=52.406
mean2770.000-2702.000=68.000
σ0.000
min2770.000-2702.000=68.000
max2770.000-2702.000=68.000
mean0.429-0.383=0.046
σ0.006-0.001=0.005
min0.425-0.381=0.043
max0.439-0.384=0.055
iters=5
new-facts=1
prior-facts=6402
mean1984.585-1931.997=52.588
σ0.018-0.011=0.008
min1984.553-1931.984=52.570
max1984.600-1932.009=52.591
mean2770.000-2702.000=68.000
σ0.000
min2770.000-2702.000=68.000
max2770.000-2702.000=68.000
mean2.583-2.508=0.075
σ0.076-0.055=0.021
min2.471-2.450=0.021
max2.653-2.589=0.064
iters=5
new-facts=6402
prior-facts=1
mean4808.238-4752.577=55.662
σ7.778-0.670=7.108
min4804.739-4752.240=52.499
max4822.152-4753.775=68.377
mean2770.000-2702.000=68.000
σ0.000
min2770.000-2702.000=68.000
max2770.000-2702.000=68.000
mean9.006-8.770=0.236
σ0.086-0.222=-0.137
min8.918-8.459=0.460
max9.137-8.997=0.140
iters=5
new-facts=6402
prior-facts=6402
mean4995.809-4943.203=52.605
σ0.019-0.016=0.003
min4995.788-4943.184=52.604
max4995.835-4943.222=52.613
mean2988.800-3019.800=-31.000
σ214.749-235.710=-20.961
min2770.000-2702.000=68.000
max3305.000-3329.000=-24.000
mean8.670-8.602=0.068
σ0.166-0.137=0.029
min8.495-8.435=0.060
max8.910-8.798=0.113

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.024=0.008
σ0.133-0.135=-0.002
min0.913-0.933=-0.021
max1.240-1.243=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.354-468.635=-0.280
σ574.229-574.938=-0.710
min181.231-181.164=0.067
max1329.697-1331.042=-1.345
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2702.000=68.000
σ0.000
min2770.000-2702.000=68.000
max2770.000-2702.000=68.000
mean0.444-0.564=-0.120
σ0.304-0.544=-0.240
min0.289-0.286=0.003
max0.899-1.379=-0.480
policies=20
mean1812.634-1811.942=0.693
σ0.400-0.379=0.022
min1812.360-1811.680=0.680
max1813.224-1812.499=0.725
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2702.000=68.000
σ0.000
min2770.000-2702.000=68.000
max2770.000-2702.000=68.000
mean2.888-2.844=0.045
σ0.025-0.017=0.008
min2.866-2.822=0.044
max2.923-2.861=0.062
policies=200
mean18131.541-18126.627=4.914
σ0.344-0.434=-0.091
min18131.317-18126.307=5.010
max18132.046-18127.262=4.784
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2702.000=68.000
σ0.000
min2770.000-2702.000=68.000
max2770.000-2702.000=68.000
mean28.386-28.690=-0.304
σ0.128-0.033=0.096
min28.247-28.644=-0.396
max28.530-28.721=-0.191