Compare commits

Home / Compare b26e787e .. e1536762

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.389=0.001
σ0.046-0.045=0.001
min70.362-70.362=0.000
max70.518-70.514=0.004
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.160-0.160=0.000
σ0.003-0.002=0.001
min0.157-0.157=0.000
max0.165-0.163=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.001
σ0.003-0.003=0.000
min21.140-21.138=0.003
max21.150-21.148=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.064-0.062=0.002
σ0.003-0.003=-0.001
min0.062-0.058=0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.392-1752.395=-0.003
σ0.361-0.360=0.000
min1751.827-1751.820=0.007
max1752.973-1752.978=-0.005
mean1651.700-1660.200=-8.500
σ643.148-636.796=6.352
min615.000-621.000=-6.000
max2775.000-2792.000=-17.000
mean2.799-2.853=-0.054
σ0.115-0.239=-0.124
min2.550-2.182=0.368
max2.935-3.486=-0.551

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-270.143=-0.002
σ0.009-0.004=0.005
min270.126-270.136=-0.010
max270.149-270.148=0.000
mean2775.000-2792.000=-17.000
σ0.000
min2775.000-2792.000=-17.000
max2775.000-2792.000=-17.000
mean0.377-0.378=-0.001
σ0.006-0.003=0.004
min0.368-0.374=-0.006
max0.386-0.382=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.605-1930.611=-0.006
σ0.011-0.010=0.002
min1930.590-1930.595=-0.005
max1930.617-1930.618=-0.001
mean2775.000-2792.000=-17.000
σ0.000
min2775.000-2792.000=-17.000
max2775.000-2792.000=-17.000
mean2.564-2.563=0.001
σ0.158-0.137=0.022
min2.454-2.449=0.005
max2.817-2.742=0.074
iters=5
new-facts=6402
prior-facts=1
mean4751.335-4751.077=0.258
σ0.880-1.096=-0.216
min4750.835-4750.251=0.584
max4752.902-4752.944=-0.042
mean2775.000-2792.000=-17.000
σ0.000
min2775.000-2792.000=-17.000
max2775.000-2792.000=-17.000
mean8.460-8.542=-0.081
σ0.304-0.807=-0.503
min8.001-7.576=0.425
max8.831-9.323=-0.492
iters=5
new-facts=6402
prior-facts=6402
mean4941.770-4941.780=-0.009
σ0.018-0.026=-0.008
min4941.754-4941.756=-0.002
max4941.798-4941.821=-0.023
mean3040.200-3025.400=14.800
σ245.460-282.705=-37.245
min2775.000-2792.000=-17.000
max3291.000-3419.000=-128.000
mean8.665-8.683=-0.018
σ0.231-0.451=-0.220
min8.423-8.312=0.111
max8.926-9.425=-0.499

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.079=-0.085
σ0.138-0.111=0.027
min0.925-0.941=-0.017
max1.240-1.251=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.370-466.375=-0.005
σ575.932-575.925=0.007
min178.397-178.408=-0.010
max1330.268-1330.262=0.006
mean84.250
σ8.500
min80.000
max97.000
mean2775.000-2792.000=-17.000
σ0.000
min2775.000-2792.000=-17.000
max2775.000-2792.000=-17.000
mean0.441-0.441=-0.001
σ0.297-0.308=-0.011
min0.291-0.283=0.007
max0.886-0.903=-0.017
policies=20
mean1784.349-1784.346=0.003
σ0.340-0.333=0.007
min1784.112-1784.108=0.004
max1784.850-1784.839=0.011
mean800.000
σ0.000
min800.000
max800.000
mean2775.000-2792.000=-17.000
σ0.000
min2775.000-2792.000=-17.000
max2775.000-2792.000=-17.000
mean2.852-2.854=-0.002
σ0.088-0.110=-0.021
min2.741-2.768=-0.027
max2.957-3.007=-0.050
policies=200
mean17849.613-17849.841=-0.227
σ0.399-0.559=-0.160
min17849.368-17849.419=-0.051
max17850.208-17850.665=-0.457
mean8000.000
σ0.000
min8000.000
max8000.000
mean2775.000-2792.000=-17.000
σ0.000
min2775.000-2792.000=-17.000
max2775.000-2792.000=-17.000
mean27.948-27.972=-0.024
σ0.104-0.179=-0.075
min27.844-27.802=0.042
max28.092-28.223=-0.130