Compare commits

Home / Compare 9abd71c6 .. 470f6f40

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.385-70.384=0.001
σ0.046-0.047=-0.001
min70.355-70.355=-0.000
max70.511-70.515=-0.005
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.159-0.158=0.001
σ0.007-0.003=0.004
min0.148-0.156=-0.008
max0.172-0.165=0.007
cache=y
dps=1
iters=10
policies=100
mean21.141-21.142=-0.001
σ0.002-0.002=0.000
min21.139-21.140=-0.001
max21.145-21.147=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.062-0.065=-0.003
σ0.004-0.003=0.002
min0.058-0.063=-0.005
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.391-1752.393=-0.001
σ0.363-0.363=-0.001
min1751.823-1751.831=-0.008
max1752.994-1752.980=0.014
mean1653.900-1659.650=-5.750
σ643.146-636.784=6.362
min623.000
max2775.000-2801.000=-26.000
mean2.821-2.869=-0.048
σ0.160-0.102=0.057
min2.444-2.723=-0.280
max3.143-3.138=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-270.125=0.016
σ0.009-0.014=-0.005
min270.130-270.113=0.017
max270.152-270.148=0.004
mean2775.000-2801.000=-26.000
σ0.000
min2775.000-2801.000=-26.000
max2775.000-2801.000=-26.000
mean0.379-0.382=-0.003
σ0.006-0.004=0.002
min0.371-0.379=-0.008
max0.386-0.390=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.608-1930.609=-0.000
σ0.002-0.009=-0.007
min1930.605-1930.597=0.007
max1930.611-1930.619=-0.008
mean2775.000-2801.000=-26.000
σ0.000
min2775.000-2801.000=-26.000
max2775.000-2801.000=-26.000
mean2.546-2.477=0.068
σ0.091-0.062=0.029
min2.464-2.413=0.051
max2.650-2.577=0.073
iters=5
new-facts=6402
prior-facts=1
mean4751.256-4751.195=0.061
σ0.916-0.914=0.001
min4750.799-4750.334=0.465
max4752.893-4752.740=0.153
mean2775.000-2801.000=-26.000
σ0.000
min2775.000-2801.000=-26.000
max2775.000-2801.000=-26.000
mean8.874-8.471=0.403
σ0.126-0.542=-0.416
min8.681-7.712=0.969
max9.017-9.112=-0.095
iters=5
new-facts=6402
prior-facts=6402
mean4941.623-4941.625=-0.002
σ0.331-0.193=0.138
min4941.032-4941.387=-0.355
max4941.790-4941.793=-0.003
mean3038.200-3027.000=11.200
σ238.116-222.185=15.931
min2775.000-2801.000=-26.000
max3339.000-3321.000=18.000
mean8.524-8.613=-0.088
σ0.225-0.248=-0.023
min8.307-8.288=0.019
max8.839-8.890=-0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.098-1.049=0.049
σ0.181-0.269=-0.088
min0.927-0.922=0.006
max1.326-1.529=-0.203

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.382-466.379=0.003
σ575.936-575.941=-0.006
min178.405-178.402=0.003
max1330.285-1330.291=-0.005
mean84.250
σ8.500
min80.000
max97.000
mean2775.000-2801.000=-26.000
σ0.000
min2775.000-2801.000=-26.000
max2775.000-2801.000=-26.000
mean0.441-0.551=-0.110
σ0.306-0.523=-0.217
min0.283-0.285=-0.002
max0.900-1.336=-0.436
policies=20
mean1784.356-1784.356=-0.000
σ0.368-0.343=0.026
min1784.101-1784.102=-0.001
max1784.900-1784.854=0.047
mean800.000
σ0.000
min800.000
max800.000
mean2775.000-2801.000=-26.000
σ0.000
min2775.000-2801.000=-26.000
max2775.000-2801.000=-26.000
mean2.850-2.851=-0.001
σ0.090-0.071=0.019
min2.780-2.760=0.019
max2.969-2.932=0.037
policies=200
mean17849.632-17849.620=0.012
σ0.460-0.500=-0.040
min17849.312-17849.234=0.078
max17850.308-17850.349=-0.042
mean8000.000
σ0.000
min8000.000
max8000.000
mean2775.000-2801.000=-26.000
σ0.000
min2775.000-2801.000=-26.000
max2775.000-2801.000=-26.000
mean28.043-27.869=0.174
σ0.128-0.053=0.075
min27.885-27.804=0.081
max28.168-27.926=0.242