Compare commits

Home / Compare 5d421413 .. a7a126ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.647=0.058
σ0.363-0.367=-0.004
min53.574-53.518=0.056
max54.738-54.691=0.047
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.137-0.142=-0.004
σ0.004-0.008=-0.003
min0.130-0.135=-0.005
max0.144-0.158=-0.014
cache=y
dps=1
iters=10
policies=100
mean42.979-42.941=0.038
σ0.006-0.007=-0.001
min42.972-42.928=0.044
max42.989-42.950=0.039
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.000
min0.115-0.119=-0.004
max0.127-0.131=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.902-991.867=3.035
σ1.177-1.198=-0.021
min994.370-991.336=3.034
max999.843-996.891=2.951
mean1062.200-1062.300=-0.100
σ315.031-317.608=-2.577
min596.000-589.000=7.000
max1570.000-1543.000=27.000
mean1.458-1.526=-0.069
σ0.128-0.048=0.079
min1.357-1.456=-0.099
max1.966-1.605=0.361

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.311-285.441=11.870
σ0.003-0.007=-0.004
min297.308-285.435=11.873
max297.315-285.452=11.864
mean1570.000-1543.000=27.000
σ0.000
min1570.000-1543.000=27.000
max1570.000-1543.000=27.000
mean0.380-0.386=-0.006
σ0.002-0.010=-0.008
min0.377-0.376=0.002
max0.382-0.398=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1298.662-1285.534=13.127
σ0.092-0.044=0.048
min1298.503-1285.462=13.041
max1298.734-1285.572=13.162
mean1570.000-1543.000=27.000
σ0.000
min1570.000-1543.000=27.000
max1570.000-1543.000=27.000
mean1.877-1.915=-0.038
σ0.043-0.138=-0.095
min1.844-1.816=0.028
max1.950-2.143=-0.194
iters=5
new-facts=6402
prior-facts=1
mean1718.874-1705.830=13.044
σ6.945-6.875=0.070
min1715.661-1702.607=13.054
max1731.295-1718.124=13.171
mean1570.000-1543.000=27.000
σ0.000
min1570.000-1543.000=27.000
max1570.000-1543.000=27.000
mean2.983-2.913=0.071
σ0.521-0.373=0.149
min2.584-2.556=0.028
max3.881-3.316=0.565
iters=5
new-facts=6402
prior-facts=6402
mean1981.625-1968.435=13.190
σ0.016-0.016=-0.000
min1981.603-1968.416=13.187
max1981.637-1968.453=13.184
mean1816.600-1789.400=27.200
σ188.744-206.898=-18.154
min1570.000-1553.000=17.000
max2051.000-2070.000=-19.000
mean3.263-3.228=0.035
σ0.146-0.071=0.075
min3.031-3.171=-0.140
max3.413-3.339=0.073

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.461-1.548=-0.087
σ0.367-0.225=0.142
min1.034-1.172=-0.138
max1.846-1.730=0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.360-436.767=3.593
σ572.864-572.354=0.510
min153.926-150.587=3.340
max1299.657-1295.298=4.359
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1570.000-1543.000=27.000
σ0.000
min1570.000-1543.000=27.000
max1570.000-1543.000=27.000
mean0.513-0.527=-0.014
σ0.494-0.548=-0.055
min0.264-0.251=0.013
max1.254-1.349=-0.096
policies=20
mean1539.503-1506.185=33.318
σ0.297-0.247=0.050
min1539.317-1506.020=33.297
max1539.944-1506.552=33.392
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1570.000-1543.000=27.000
σ0.000
min1570.000-1543.000=27.000
max1570.000-1543.000=27.000
mean2.558-2.532=0.026
σ0.016-0.026=-0.009
min2.543-2.512=0.030
max2.575-2.570=0.005
policies=200
mean15403.041-15069.511=333.530
σ0.129-0.082=0.047
min15402.912-15069.398=333.514
max15403.212-15069.593=333.619
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1570.000-1543.000=27.000
σ0.000
min1570.000-1543.000=27.000
max1570.000-1543.000=27.000
mean25.879-25.559=0.320
σ0.099-0.180=-0.081
min25.776-25.342=0.435
max25.998-25.766=0.232