Compare commits

Home / Compare 16d07eaa .. cbab7657

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.565=-0.002
σ0.050-0.044=0.005
min70.536-70.537=-0.000
max70.703-70.687=0.016
mean413.300-414.000=-0.700
σ0.483-0.000=0.483
min413.000-414.000=-1.000
max414.000
mean0.159-0.157=0.002
σ0.003-0.006=-0.003
min0.156-0.150=0.006
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.290-21.288=0.003
σ0.012-0.003=0.009
min21.283-21.282=0.001
max21.323-21.291=0.032
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.063-0.059=0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1753.174=-0.000
σ0.362-0.361=0.001
min1752.605-1752.605=-0.000
max1753.759-1753.752=0.007
mean1647.800-1658.500=-10.700
σ633.346-622.823=10.523
min632.000-668.000=-36.000
max2775.000-2665.000=110.000
mean2.805-2.830=-0.025
σ0.177-0.147=0.030
min2.351-2.416=-0.065
max3.010-3.035=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.616-271.620=-0.004
σ0.008-0.004=0.004
min271.611-271.615=-0.003
max271.629-271.625=0.005
mean2775.000-2665.000=110.000
σ0.000
min2775.000-2665.000=110.000
max2775.000-2665.000=110.000
mean0.384-0.387=-0.003
σ0.007-0.011=-0.004
min0.379-0.377=0.001
max0.396-0.401=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.049-1932.050=-0.001
σ0.017-0.010=0.007
min1932.031-1932.042=-0.011
max1932.076-1932.068=0.009
mean2775.000-2665.000=110.000
σ0.000
min2775.000-2665.000=110.000
max2775.000-2665.000=110.000
mean2.938-2.950=-0.011
σ0.272-0.294=-0.022
min2.506-2.506=-0.000
max3.228-3.334=-0.106
iters=5
new-facts=6402
prior-facts=1
mean4752.859-4752.850=0.009
σ0.776-0.808=-0.032
min4752.472-4752.412=0.059
max4754.246-4754.294=-0.048
mean2775.000-2665.000=110.000
σ0.000
min2775.000-2665.000=110.000
max2775.000-2665.000=110.000
mean7.901-7.935=-0.035
σ0.246-0.368=-0.122
min7.658-7.602=0.056
max8.281-8.550=-0.269
iters=5
new-facts=6402
prior-facts=6402
mean4943.232-4943.224=0.008
σ0.019-0.019=0.000
min4943.208-4943.201=0.006
max4943.257-4943.243=0.014
mean3052.800-3005.400=47.400
σ338.134-382.029=-43.895
min2775.000-2665.000=110.000
max3562.000-3554.000=8.000
mean8.465-8.465=0.001
σ0.092-0.103=-0.011
min8.377-8.347=0.029
max8.598-8.629=-0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.177=-0.104
σ0.116-0.272=-0.157
min0.933-0.946=-0.013
max1.255-1.559=-0.304

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.297-472.286=0.011
σ575.924-575.928=-0.004
min184.326-184.317=0.009
max1336.182-1336.177=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2775.000-2665.000=110.000
σ0.000
min2775.000-2665.000=110.000
max2775.000-2665.000=110.000
mean0.485-0.565=-0.080
σ0.373-0.540=-0.167
min0.297-0.288=0.009
max1.044-1.375=-0.331
policies=20
mean1843.587-1843.519=0.068
σ0.366-0.388=-0.022
min1843.308-1843.258=0.050
max1844.118-1844.091=0.027
mean840.000
σ0.000
min840.000
max840.000
mean2775.000-2665.000=110.000
σ0.000
min2775.000-2665.000=110.000
max2775.000-2665.000=110.000
mean2.971-2.894=0.076
σ0.157-0.028=0.129
min2.858-2.870=-0.012
max3.196-2.926=0.270
policies=200
mean18442.223-18442.116=0.107
σ0.498-0.514=-0.016
min18441.910-18441.752=0.159
max18442.965-18442.870=0.095
mean8400.000
σ0.000
min8400.000
max8400.000
mean2775.000-2665.000=110.000
σ0.000
min2775.000-2665.000=110.000
max2775.000-2665.000=110.000
mean28.989-29.034=-0.045
σ0.209-0.280=-0.071
min28.808-28.679=0.129
max29.170-29.345=-0.175