Compare commits

Home / Compare 50074109 .. 7f6770a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.391=-0.001
σ0.046-0.047=-0.001
min70.361-70.362=-0.001
max70.517-70.521=-0.004
mean417.400-415.000=2.400
σ0.516-0.000=0.516
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.159-0.162=-0.002
σ0.003-0.003=-0.000
min0.156-0.158=-0.002
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.003=0.001
min21.140-21.141=-0.001
max21.149-21.149=-0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.064-0.064=-0.001
σ0.002-0.002=-0.000
min0.062-0.062=0.000
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.001
σ0.363-0.360=0.003
min1751.825-1751.828=-0.003
max1752.982-1752.981=0.001
mean1657.450-1658.100=-0.650
σ628.177-629.040=-0.863
min621.000-619.000=2.000
max2772.000-2775.000=-3.000
mean2.818-2.858=-0.040
σ0.212-0.096=0.115
min2.207-2.631=-0.424
max3.062-3.070=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.143=0.000
σ0.010-0.004=0.006
min270.129-270.136=-0.007
max270.154-270.146=0.009
mean2772.000-2775.000=-3.000
σ0.000
min2772.000-2775.000=-3.000
max2772.000-2775.000=-3.000
mean0.377-0.378=-0.000
σ0.002-0.002=0.000
min0.374-0.375=-0.002
max0.380-0.379=0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.604-1930.594=0.010
σ0.009-0.023=-0.014
min1930.597-1930.570=0.027
max1930.618-1930.616=0.002
mean2772.000-2775.000=-3.000
σ0.000
min2772.000-2775.000=-3.000
max2772.000-2775.000=-3.000
mean2.503-2.532=-0.028
σ0.116-0.185=-0.069
min2.346-2.327=0.019
max2.623-2.830=-0.207
iters=5
new-facts=6402
prior-facts=1
mean4751.355-4751.308=0.047
σ0.959-0.899=0.060
min4750.740-4750.793=-0.053
max4753.051-4752.905=0.146
mean2772.000-2775.000=-3.000
σ0.000
min2772.000-2775.000=-3.000
max2772.000-2775.000=-3.000
mean8.427-8.521=-0.094
σ0.681-0.551=0.130
min7.644-7.644=-0.000
max9.362-9.065=0.297
iters=5
new-facts=6402
prior-facts=6402
mean4941.773-4941.704=0.070
σ0.016-0.172=-0.157
min4941.755-4941.396=0.359
max4941.790-4941.795=-0.005
mean3051.000-3010.000=41.000
σ256.482-219.589=36.893
min2772.000-2775.000=-3.000
max3306.000-3308.000=-2.000
mean8.721-8.513=0.208
σ0.391-0.123=0.269
min8.378-8.385=-0.006
max9.360-8.683=0.678

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-0.998=0.051
σ0.124-0.147=-0.023
min0.933-0.927=0.007
max1.240-1.262=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.374-466.374=-0.000
σ575.929-575.928=0.001
min178.409-178.400=0.009
max1330.267-1330.266=0.001
mean84.250
σ8.500
min80.000
max97.000
mean2772.000-2775.000=-3.000
σ0.000
min2772.000-2775.000=-3.000
max2772.000-2775.000=-3.000
mean0.434-0.441=-0.008
σ0.309-0.300=0.009
min0.258-0.286=-0.028
max0.897-0.892=0.005
policies=20
mean1784.369-1784.351=0.019
σ0.369-0.372=-0.003
min1784.129-1784.105=0.024
max1784.915-1784.902=0.013
mean800.000
σ0.000
min800.000
max800.000
mean2772.000-2775.000=-3.000
σ0.000
min2772.000-2775.000=-3.000
max2772.000-2775.000=-3.000
mean2.862-2.843=0.019
σ0.114-0.076=0.038
min2.757-2.772=-0.015
max3.017-2.942=0.075
policies=200
mean17849.741-17849.819=-0.079
σ0.465-0.529=-0.064
min17849.466-17849.383=0.083
max17850.433-17850.588=-0.155
mean8000.000
σ0.000
min8000.000
max8000.000
mean2772.000-2775.000=-3.000
σ0.000
min2772.000-2775.000=-3.000
max2772.000-2775.000=-3.000
mean27.955-28.010=-0.055
σ0.108-0.184=-0.076
min27.861-27.851=0.009
max28.073-28.274=-0.201