Compare commits

Home / Compare 381f6fb8 .. 7c4a80b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.735-70.735=0.000
σ0.051-0.051=-0.001
min70.704-70.704=0.000
max70.876-70.877=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.162-0.160=0.001
σ0.003-0.003=-0.000
min0.158-0.156=0.003
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.449-21.448=0.000
σ0.003-0.003=-0.001
min21.445-21.443=0.001
max21.452-21.453=-0.001
mean414.800-418.000=-3.200
σ0.422-0.000=0.422
min414.000-418.000=-4.000
max415.000-418.000=-3.000
mean0.065-0.066=-0.001
σ0.003-0.003=0.000
min0.061-0.064=-0.003
max0.073-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1751.881=0.001
σ0.362-0.360=0.002
min1751.307-1751.310=-0.003
max1752.477-1752.469=0.007
mean1651.300-1663.500=-12.200
σ642.460-631.049=11.411
min625.000-678.000=-53.000
max2860.000-2713.000=147.000
mean2.787-2.788=-0.002
σ0.220-0.211=0.009
min2.124-2.293=-0.169
max3.009-3.038=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.968-270.972=-0.003
σ0.008-0.005=0.003
min270.960-270.966=-0.006
max270.980-270.978=0.002
mean2860.000-2713.000=147.000
σ0.000
min2860.000-2713.000=147.000
max2860.000-2713.000=147.000
mean0.380-0.372=0.007
σ0.003-0.005=-0.002
min0.377-0.369=0.009
max0.386-0.381=0.005
iters=5
new-facts=1
prior-facts=6402
mean1931.347-1931.347=0.000
σ0.005-0.021=-0.015
min1931.340-1931.329=0.012
max1931.353-1931.381=-0.028
mean2860.000-2713.000=147.000
σ0.000
min2860.000-2713.000=147.000
max2860.000-2713.000=147.000
mean3.064-3.017=0.047
σ0.076-0.035=0.040
min3.022-2.969=0.053
max3.198-3.067=0.131
iters=5
new-facts=6402
prior-facts=1
mean4752.074-4752.129=-0.055
σ0.865-0.929=-0.065
min4751.598-4751.547=0.051
max4753.616-4753.781=-0.165
mean2860.000-2713.000=147.000
σ0.000
min2860.000-2713.000=147.000
max2860.000-2713.000=147.000
mean8.675-8.553=0.123
σ0.582-0.432=0.151
min7.808-8.116=-0.308
max9.195-9.216=-0.021
iters=5
new-facts=6402
prior-facts=6402
mean4942.586-4942.584=0.002
σ0.020-0.014=0.007
min4942.558-4942.570=-0.012
max4942.611-4942.602=0.008
mean3055.200-2994.800=60.400
σ214.390-315.414=-101.024
min2860.000-2713.000=147.000
max3380.000-3445.000=-65.000
mean8.755-8.406=0.350
σ0.370-0.043=0.328
min8.440-8.376=0.065
max9.312-8.479=0.833

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.173=-0.126
σ0.134-0.226=-0.092
min0.926-0.928=-0.001
max1.255-1.523=-0.267

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.060-466.059=0.000
σ574.925-574.936=-0.011
min178.593-178.588=0.005
max1328.448-1328.463=-0.016
mean86.250
σ8.500
min82.000
max99.000
mean2860.000-2713.000=147.000
σ0.000
min2860.000-2713.000=147.000
max2860.000-2713.000=147.000
mean0.464-0.571=-0.108
σ0.350-0.585=-0.235
min0.284-0.272=0.012
max0.989-1.449=-0.461
policies=20
mean1786.183-1786.139=0.044
σ0.362-0.372=-0.011
min1785.923-1785.910=0.012
max1786.716-1786.695=0.021
mean820.000
σ0.000
min820.000
max820.000
mean2860.000-2713.000=147.000
σ0.000
min2860.000-2713.000=147.000
max2860.000-2713.000=147.000
mean2.846-2.775=0.071
σ0.001-0.018=-0.017
min2.845-2.756=0.090
max2.848-2.792=0.056
policies=200
mean17868.433-17868.521=-0.087
σ0.560-0.491=0.069
min17868.105-17868.205=-0.100
max17869.271-17869.253=0.018
mean8200.000
σ0.000
min8200.000
max8200.000
mean2860.000-2713.000=147.000
σ0.000
min2860.000-2713.000=147.000
max2860.000-2713.000=147.000
mean28.326-27.893=0.434
σ0.395-0.124=0.271
min27.886-27.728=0.158
max28.696-27.998=0.698