Compare commits

Home / Compare 2ebaa079 .. 938a324f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.648=0.062
σ0.365-0.366=-0.001
min53.569-53.513=0.056
max54.750-54.690=0.060
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.139-0.139=-0.000
σ0.003-0.004=-0.001
min0.136-0.135=0.001
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean42.977-42.946=0.032
σ0.006-0.009=-0.003
min42.969-42.938=0.032
max42.986-42.967=0.020
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.121-0.119=0.002
σ0.003-0.004=-0.001
min0.118-0.114=0.004
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.215-991.864=3.351
σ1.218-1.218=0.000
min994.689-991.297=3.392
max1000.325-996.952=3.372
mean1073.050-1057.250=15.800
σ319.946-315.866=4.079
min595.000-582.000=13.000
max1632.000-1488.000=144.000
mean1.492-1.549=-0.057
σ0.072-0.087=-0.015
min1.405-1.443=-0.038
max1.670-1.796=-0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.316-285.433=11.883
σ0.003-0.015=-0.011
min297.312-285.411=11.901
max297.319-285.451=11.868
mean1632.000-1488.000=144.000
σ0.000
min1632.000-1488.000=144.000
max1632.000-1488.000=144.000
mean0.388-0.375=0.013
σ0.000-0.002=-0.002
min0.388-0.374=0.014
max0.389-0.379=0.010
iters=5
new-facts=1
prior-facts=6402
mean1299.020-1285.518=13.501
σ0.069-0.093=-0.024
min1298.902-1285.353=13.549
max1299.067-1285.574=13.493
mean1632.000-1488.000=144.000
σ0.000
min1632.000-1488.000=144.000
max1632.000-1488.000=144.000
mean1.916-2.012=-0.096
σ0.118-0.269=-0.151
min1.833-1.813=0.021
max2.124-2.444=-0.320
iters=5
new-facts=6402
prior-facts=1
mean1719.185-1705.824=13.361
σ6.860-6.847=0.014
min1715.996-1702.650=13.347
max1731.454-1718.069=13.385
mean1632.000-1488.000=144.000
σ0.000
min1632.000-1488.000=144.000
max1632.000-1488.000=144.000
mean2.943-3.146=-0.202
σ0.252-0.218=0.034
min2.602-2.796=-0.194
max3.214-3.373=-0.159
iters=5
new-facts=6402
prior-facts=6402
mean1981.915-1968.420=13.495
σ0.029-0.029=-0.000
min1981.869-1968.368=13.500
max1981.941-1968.437=13.504
mean1803.000-1780.400=22.600
σ200.858-190.107=10.751
min1632.000-1544.000=88.000
max2101.000-2023.000=78.000
mean3.405-3.312=0.093
σ0.392-0.392=-0.000
min3.091-3.087=0.004
max4.077-4.011=0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.183-1.641=-0.458
σ0.315-0.081=0.234
min0.915-1.541=-0.626
max1.678-1.749=-0.071

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.457-436.765=3.692
σ573.037-572.350=0.687
min153.929-150.587=3.342
max1300.012-1295.290=4.722
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1632.000-1488.000=144.000
σ0.000
min1632.000-1488.000=144.000
max1632.000-1488.000=144.000
mean0.559-0.520=0.039
σ0.609-0.543=0.066
min0.252-0.236=0.016
max1.473-1.334=0.138
policies=20
mean1539.571-1506.152=33.419
σ0.293-0.227=0.066
min1539.383-1505.991=33.392
max1540.006-1506.488=33.518
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1632.000-1488.000=144.000
σ0.000
min1632.000-1488.000=144.000
max1632.000-1488.000=144.000
mean2.549-2.501=0.047
σ0.013-0.047=-0.034
min2.537-2.434=0.103
max2.565-2.542=0.022
policies=200
mean15403.662-15069.432=334.230
σ0.124-0.074=0.050
min15403.501-15069.370=334.131
max15403.764-15069.534=334.230
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1632.000-1488.000=144.000
σ0.000
min1632.000-1488.000=144.000
max1632.000-1488.000=144.000
mean26.160-25.444=0.716
σ0.310-0.096=0.213
min25.826-25.322=0.504
max26.470-25.555=0.915