Compare commits

Home / Compare e4d06f78 .. 4a5a7a09

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.002
σ0.107-0.104=0.003
min35.928-35.926=0.002
max36.278-36.269=0.010
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.076-0.075=0.001
σ0.005-0.005=0.001
min0.070-0.070=0.001
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.001
σ0.003-0.004=-0.001
min26.203-26.201=0.002
max26.214-26.213=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.365=-0.001
σ0.372-0.370=0.001
min1757.787-1757.787=-0.000
max1758.963-1758.963=-0.001
mean1657.400-1660.250=-2.850
σ624.196-624.261=-0.065
min686.000-688.000=-2.000
max2766.000-2768.000=-2.000
mean2.371-2.390=-0.018
σ0.112-0.109=0.003
min2.227-2.276=-0.049
max2.608-2.608=-0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.509-279.511=-0.002
σ0.004-0.009=-0.004
min279.502-279.499=0.003
max279.513-279.519=-0.006
mean2766.000-2768.000=-2.000
σ0.000
min2766.000-2768.000=-2.000
max2766.000-2768.000=-2.000
mean0.409-0.411=-0.002
σ0.001-0.007=-0.005
min0.407-0.405=0.002
max0.410-0.421=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2178.436-2178.425=0.011
σ0.009-0.037=-0.028
min2178.422-2178.359=0.063
max2178.444-2178.449=-0.005
mean2766.000-2768.000=-2.000
σ0.000
min2766.000-2768.000=-2.000
max2766.000-2768.000=-2.000
mean3.259-3.389=-0.130
σ0.260-0.117=0.143
min2.830-3.268=-0.438
max3.507-3.530=-0.023
iters=5
new-facts=6402
prior-facts=1
mean5056.375-5056.357=0.018
σ0.984-0.973=0.011
min5055.797-5055.766=0.031
max5058.126-5058.083=0.043
mean2766.000-2768.000=-2.000
σ0.000
min2766.000-2768.000=-2.000
max2766.000-2768.000=-2.000
mean8.695-9.034=-0.339
σ0.557-0.490=0.067
min8.150-8.168=-0.018
max9.534-9.359=0.175
iters=5
new-facts=6402
prior-facts=6402
mean5193.681-5193.674=0.007
σ0.126-0.125=0.001
min5193.503-5193.505=-0.002
max5193.855-5193.857=-0.002
mean3238.400-3276.200=-37.800
σ331.760-460.996=-129.236
min2766.000-2768.000=-2.000
max3673.000-3914.000=-241.000
mean9.107-8.976=0.131
σ0.516-0.099=0.417
min8.698-8.861=-0.162
max9.709-9.094=0.615

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-0.956=0.019
σ0.056-0.014=0.042
min0.939-0.947=-0.008
max1.070-0.979=0.091

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.471-465.474=-0.002
σ572.662-572.659=0.004
min179.139-179.143=-0.004
max1324.464-1324.461=0.003
mean79.500
σ7.000
min76.000
max90.000
mean2766.000-2768.000=-2.000
σ0.000
min2766.000-2768.000=-2.000
max2766.000-2768.000=-2.000
mean0.469-0.484=-0.015
σ0.391-0.403=-0.012
min0.265-0.280=-0.015
max1.056-1.089=-0.033
policies=20
mean1791.673-1791.705=-0.032
σ0.317-0.330=-0.013
min1791.478-1791.511=-0.034
max1792.144-1792.197=-0.053
mean760.000
σ0.000
min760.000
max760.000
mean2766.000-2768.000=-2.000
σ0.000
min2766.000-2768.000=-2.000
max2766.000-2768.000=-2.000
mean2.790-2.804=-0.014
σ0.015-0.008=0.007
min2.775-2.797=-0.022
max2.811-2.814=-0.002
policies=200
mean17923.239-17923.387=-0.148
σ0.527-0.564=-0.038
min17922.943-17923.065=-0.122
max17924.027-17924.230=-0.202
mean7600.000
σ0.000
min7600.000
max7600.000
mean2766.000-2768.000=-2.000
σ0.000
min2766.000-2768.000=-2.000
max2766.000-2768.000=-2.000
mean28.357-28.250=0.107
σ0.047-0.112=-0.064
min28.290-28.141=0.149
max28.400-28.367=0.033