Compare commits

Home / Compare ae86932d .. a24d8e6d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.381=-0.001
σ0.048-0.047=0.001
min70.350-70.352=-0.002
max70.516-70.513=0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.160-0.159=0.000
σ0.003-0.003=0.000
min0.156-0.154=0.002
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.003=-0.001
min21.141-21.140=0.001
max21.148-21.150=-0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.064-0.064=-0.001
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1714.464=37.920
σ0.364-169.525=-169.160
min1751.820-994.236=757.584
max1752.977-1752.999=-0.022
mean1659.500-1639.800=19.700
σ636.637-607.630=29.007
min617.000-668.000=-51.000
max2791.000-2468.000=323.000
mean2.732-2.738=-0.007
σ0.209-0.346=-0.137
min2.164-1.403=0.761
max2.954-3.119=-0.165

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.127-270.124=0.004
σ0.009-0.010=-0.000
min270.116-270.113=0.004
max270.141-270.135=0.005
mean2791.000-2468.000=323.000
σ0.000
min2791.000-2468.000=323.000
max2791.000-2468.000=323.000
mean0.370-0.371=-0.001
σ0.002-0.002=0.000
min0.368-0.369=-0.001
max0.372-0.373=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.590-1930.594=-0.004
σ0.019-0.007=0.012
min1930.565-1930.583=-0.018
max1930.612-1930.600=0.012
mean2791.000-2468.000=323.000
σ0.000
min2791.000-2468.000=323.000
max2791.000-2468.000=323.000
mean2.631-2.520=0.111
σ0.117-0.111=0.006
min2.449-2.387=0.062
max2.723-2.693=0.030
iters=5
new-facts=6402
prior-facts=1
mean4751.058-4750.939=0.119
σ0.852-0.966=-0.113
min4750.586-4749.993=0.593
max4752.577-4752.571=0.006
mean2791.000-2468.000=323.000
σ0.000
min2791.000-2468.000=323.000
max2791.000-2468.000=323.000
mean8.715-8.608=0.107
σ0.499-0.653=-0.154
min7.893-7.645=0.248
max9.212-9.227=-0.014
iters=5
new-facts=6402
prior-facts=6402
mean4941.461-4941.249=0.212
σ0.207-0.377=-0.169
min4941.116-4940.759=0.356
max4941.626-4941.634=-0.008
mean3040.800-2977.000=63.800
σ297.100-283.447=13.654
min2791.000-2592.000=199.000
max3484.000-3314.000=170.000
mean8.628-8.511=0.117
σ0.142-0.165=-0.024
min8.474-8.250=0.224
max8.784-8.698=0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.624=-0.623
σ0.133-0.259=-0.126
min0.932-1.255=-0.323
max1.240-1.929=-0.689

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.370-466.354=0.015
σ575.929-575.920=0.009
min178.393-178.385=0.008
max1330.263-1330.234=0.029
mean84.000
σ8.000
min80.000
max96.000
mean2791.000-2468.000=323.000
σ0.000
min2791.000-2468.000=323.000
max2791.000-2468.000=323.000
mean0.442-0.555=-0.113
σ0.313-0.551=-0.238
min0.285-0.278=0.007
max0.912-1.382=-0.471
policies=20
mean1784.266-1784.216=0.050
σ0.338-0.365=-0.027
min1784.024-1783.973=0.051
max1784.765-1784.758=0.007
mean800.000
σ0.000
min800.000
max800.000
mean2791.000-2468.000=323.000
σ0.000
min2791.000-2468.000=323.000
max2791.000-2468.000=323.000
mean2.846-2.775=0.071
σ0.121-0.014=0.106
min2.753-2.754=-0.000
max3.013-2.784=0.229
policies=200
mean17848.874-17848.792=0.082
σ0.482-0.328=0.154
min17848.578-17848.571=0.007
max17849.594-17849.276=0.318
mean8000.000
σ0.000
min8000.000
max8000.000
mean2791.000-2468.000=323.000
σ0.000
min2791.000-2468.000=323.000
max2791.000-2468.000=323.000
mean27.988-28.093=-0.105
σ0.107-0.154=-0.047
min27.913-27.895=0.018
max28.147-28.272=-0.125