Compare commits

Home / Compare 1fde8f0d .. e414a96b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.385=0.007
σ0.045-0.049=-0.004
min70.370-70.356=0.015
max70.518-70.520=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.158-0.161=-0.004
σ0.004-0.004=-0.000
min0.150-0.154=-0.004
max0.163-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.144-21.141=0.003
σ0.003-0.004=-0.001
min21.138-21.135=0.003
max21.147-21.148=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.060-0.063=-0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.698-1752.391=0.307
σ0.362-0.363=-0.001
min1752.128-1751.825=0.303
max1753.284-1752.987=0.297
mean1652.450-1650.000=2.450
σ641.212-637.338=3.874
min620.000-618.000=2.000
max2768.000-2838.000=-70.000
mean2.727-2.775=-0.048
σ0.197-0.145=0.052
min2.323-2.520=-0.197
max3.106-3.087=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.608-270.142=0.467
σ0.009-0.007=0.002
min270.595-270.131=0.464
max270.620-270.148=0.473
mean2768.000-2838.000=-70.000
σ0.000
min2768.000-2838.000=-70.000
max2768.000-2838.000=-70.000
mean0.378-0.376=0.002
σ0.004-0.002=0.002
min0.375-0.372=0.003
max0.385-0.377=0.007
iters=5
new-facts=1
prior-facts=6402
mean1931.044-1930.595=0.450
σ0.003-0.025=-0.022
min1931.041-1930.559=0.481
max1931.048-1930.620=0.428
mean2768.000-2838.000=-70.000
σ0.000
min2768.000-2838.000=-70.000
max2768.000-2838.000=-70.000
mean3.077-2.564=0.513
σ0.195-0.152=0.044
min2.921-2.466=0.455
max3.399-2.831=0.568
iters=5
new-facts=6402
prior-facts=1
mean4751.691-4751.286=0.405
σ0.940-0.891=0.049
min4750.811-4750.776=0.034
max4753.283-4752.874=0.410
mean2768.000-2838.000=-70.000
σ0.000
min2768.000-2838.000=-70.000
max2768.000-2838.000=-70.000
mean8.338-8.467=-0.129
σ0.485-0.628=-0.143
min7.763-7.521=0.243
max9.027-9.042=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean4942.239-4941.766=0.473
σ0.024-0.023=0.001
min4942.202-4941.738=0.464
max4942.266-4941.791=0.475
mean3073.600-3029.400=44.200
σ294.350-198.549=95.801
min2768.000-2838.000=-70.000
max3367.000-3311.000=56.000
mean8.936-8.569=0.367
σ0.545-0.182=0.363
min8.311-8.397=-0.086
max9.640-8.872=0.768

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.048-1.092=-0.045
σ0.133-0.202=-0.069
min0.928-0.934=-0.005
max1.255-1.434=-0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.199-466.372=0.827
σ575.920-575.925=-0.005
min179.236-178.401=0.835
max1331.079-1330.260=0.819
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2768.000-2838.000=-70.000
σ0.000
min2768.000-2838.000=-70.000
max2768.000-2838.000=-70.000
mean0.442-0.444=-0.002
σ0.300-0.309=-0.009
min0.291-0.284=0.007
max0.891-0.907=-0.016
policies=20
mean1792.589-1784.342=8.246
σ0.337-0.369=-0.032
min1792.334-1784.076=8.258
max1793.084-1784.884=8.200
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2768.000-2838.000=-70.000
σ0.000
min2768.000-2838.000=-70.000
max2768.000-2838.000=-70.000
mean2.824-2.849=-0.025
σ0.092-0.014=0.077
min2.762-2.838=-0.075
max2.960-2.870=0.090
policies=200
mean17932.969-17849.785=83.183
σ0.574-0.495=0.080
min17932.547-17849.472=83.075
max17933.810-17850.517=83.294
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2768.000-2838.000=-70.000
σ0.000
min2768.000-2838.000=-70.000
max2768.000-2838.000=-70.000
mean28.027-27.935=0.092
σ0.122-0.174=-0.051
min27.886-27.745=0.140
max28.152-28.104=0.047