Compare commits

Home / Compare 3a1b27ee .. 85e4e02d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.376=-0.001
σ0.057-0.056=0.001
min70.343-70.346=-0.003
max70.534-70.531=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.160-0.166=-0.007
σ0.003-0.008=-0.004
min0.155-0.157=-0.002
max0.166-0.178=-0.012
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=0.000
σ0.003-0.002=0.002
min21.140-21.140=-0.000
max21.149-21.144=0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.001
min0.061-0.058=0.003
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.200=0.000
σ0.360-0.361=-0.001
min1751.631-1751.633=-0.002
max1752.783-1752.790=-0.007
mean1664.300-1644.400=19.900
σ627.235-616.990=10.244
min685.000-635.000=50.000
max2762.000-2481.000=281.000
mean2.824-2.786=0.038
σ0.116-0.146=-0.030
min2.431-2.407=0.024
max2.960-2.973=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.931-269.937=-0.006
σ0.009-0.004=0.005
min269.923-269.932=-0.009
max269.944-269.942=0.002
mean2762.000-2481.000=281.000
σ0.000
min2762.000-2481.000=281.000
max2762.000-2481.000=281.000
mean0.373-0.388=-0.015
σ0.006-0.012=-0.006
min0.370-0.379=-0.009
max0.384-0.409=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1930.385-1930.403=-0.017
σ0.016-0.004=0.012
min1930.366-1930.398=-0.032
max1930.406-1930.408=-0.002
mean2762.000-2481.000=281.000
σ0.000
min2762.000-2481.000=281.000
max2762.000-2481.000=281.000
mean2.605-2.474=0.130
σ0.305-0.035=0.270
min2.373-2.436=-0.062
max3.140-2.527=0.612
iters=5
new-facts=6402
prior-facts=1
mean4750.612-4750.788=-0.177
σ1.112-0.915=0.197
min4749.169-4750.006=-0.837
max4752.286-4752.374=-0.088
mean2762.000-2481.000=281.000
σ0.000
min2762.000-2481.000=281.000
max2762.000-2481.000=281.000
mean8.634-8.385=0.249
σ0.302-0.509=-0.207
min8.305-7.663=0.641
max9.029-9.016=0.013
iters=5
new-facts=6402
prior-facts=6402
mean4941.334-4941.331=0.003
σ0.087-0.090=-0.004
min4941.255-4941.254=0.001
max4941.428-4941.431=-0.003
mean3031.600-2996.200=35.400
σ228.977-283.369=-54.393
min2762.000-2606.000=156.000
max3304.000-3330.000=-26.000
mean8.754-8.563=0.191
σ0.400-0.127=0.273
min8.362-8.419=-0.057
max9.359-8.754=0.604

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.063-1.738=-0.675
σ0.128-0.132=-0.004
min0.944-1.596=-0.652
max1.260-1.874=-0.615

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.921-465.933=-0.012
σ575.784-575.814=-0.030
min178.018-178.024=-0.006
max1329.598-1329.654=-0.057
mean81.750
σ7.500
min78.000
max93.000
mean2762.000-2481.000=281.000
σ0.000
min2762.000-2481.000=281.000
max2762.000-2481.000=281.000
mean0.556-0.556=0.001
σ0.547-0.548=-0.002
min0.278-0.281=-0.003
max1.376-1.378=-0.002
policies=20
mean1780.454-1780.463=-0.009
σ0.346-0.339=0.007
min1780.218-1780.223=-0.006
max1780.967-1780.963=0.004
mean780.000
σ0.000
min780.000
max780.000
mean2762.000-2481.000=281.000
σ0.000
min2762.000-2481.000=281.000
max2762.000-2481.000=281.000
mean2.750-2.763=-0.013
σ0.026-0.014=0.012
min2.732-2.750=-0.018
max2.789-2.782=0.006
policies=200
mean17811.549-17811.377=0.172
σ0.509-0.569=-0.060
min17811.258-17810.988=0.270
max17812.311-17812.216=0.095
mean7800.000
σ0.000
min7800.000
max7800.000
mean2762.000-2481.000=281.000
σ0.000
min2762.000-2481.000=281.000
max2762.000-2481.000=281.000
mean27.910-27.862=0.048
σ0.217-0.044=0.173
min27.769-27.820=-0.050
max28.228-27.906=0.322