Compare commits

Home / Compare 4a7a7cc7 .. 0a1309fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.975=-0.002
σ0.107-0.107=0.000
min35.921-35.929=-0.008
max36.278-36.279=-0.001
mean412.000-410.300=1.700
σ0.000-0.483=-0.483
min412.000-410.000=2.000
max412.000-411.000=1.000
mean0.075-0.077=-0.001
σ0.005-0.004=0.001
min0.069-0.074=-0.004
max0.083-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.004-0.003=0.001
min26.201-26.205=-0.004
max26.214-26.213=0.001
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.059-0.060=-0.001
σ0.004-0.002=0.002
min0.056-0.058=-0.002
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.367-1758.365=0.002
σ0.370-0.375=-0.004
min1757.791-1757.786=0.005
max1758.963-1758.961=0.002
mean1655.150-1648.650=6.500
σ620.489-643.859=-23.369
min686.000-670.000=16.000
max2746.000-2734.000=12.000
mean2.352-2.345=0.008
σ0.111-0.092=0.020
min2.138-2.190=-0.052
max2.567-2.520=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.511-279.511=0.000
σ0.009-0.005=0.003
min279.500-279.505=-0.005
max279.520-279.515=0.005
mean2746.000-2734.000=12.000
σ0.000
min2746.000-2734.000=12.000
max2746.000-2734.000=12.000
mean0.411-0.405=0.005
σ0.007-0.001=0.005
min0.404-0.404=0.000
max0.419-0.407=0.012
iters=5
new-facts=1
prior-facts=6402
mean2178.441-2178.438=0.003
σ0.014-0.020=-0.005
min2178.419-2178.414=0.005
max2178.453-2178.468=-0.015
mean2746.000-2734.000=12.000
σ0.000
min2746.000-2734.000=12.000
max2746.000-2734.000=12.000
mean3.141-3.400=-0.259
σ0.552-0.227=0.325
min2.671-3.167=-0.495
max4.041-3.770=0.271
iters=5
new-facts=6402
prior-facts=1
mean5056.403-5056.386=0.017
σ0.979-0.990=-0.011
min5055.873-5055.779=0.094
max5058.138-5058.147=-0.009
mean2746.000-2734.000=12.000
σ0.000
min2746.000-2734.000=12.000
max2746.000-2734.000=12.000
mean9.171-8.880=0.292
σ0.750-0.708=0.042
min8.162-8.096=0.067
max10.125-9.724=0.401
iters=5
new-facts=6402
prior-facts=6402
mean5193.607-5193.754=-0.147
σ0.255-0.087=0.167
min5193.337-5193.685=-0.347
max5193.856-5193.853=0.002
mean3193.000-3279.400=-86.400
σ443.104-405.250=37.854
min2746.000-2734.000=12.000
max3814.000-3666.000=148.000
mean8.651-8.847=-0.196
σ0.126-0.169=-0.043
min8.535-8.672=-0.137
max8.864-9.086=-0.221

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-1.032=-0.087
σ0.010-0.138=-0.129
min0.938-0.937=0.000
max0.962-1.255=-0.293

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.481-465.482=-0.001
σ572.660-572.661=-0.002
min179.143-179.140=0.003
max1324.470-1324.474=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2746.000-2734.000=12.000
σ0.000
min2746.000-2734.000=12.000
max2746.000-2734.000=12.000
mean0.473-0.558=-0.085
σ0.387-0.556=-0.169
min0.279-0.278=0.001
max1.053-1.391=-0.338
policies=20
mean1791.703-1791.671=0.032
σ0.327-0.352=-0.024
min1791.515-1791.456=0.058
max1792.192-1792.196=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean2746.000-2734.000=12.000
σ0.000
min2746.000-2734.000=12.000
max2746.000-2734.000=12.000
mean2.803-2.773=0.030
σ0.013-0.016=-0.003
min2.788-2.749=0.039
max2.818-2.783=0.035
policies=200
mean17923.411-17923.529=-0.118
σ0.443-0.495=-0.053
min17923.059-17923.273=-0.213
max17924.058-17924.271=-0.213
mean7600.000
σ0.000
min7600.000
max7600.000
mean2746.000-2734.000=12.000
σ0.000
min2746.000-2734.000=12.000
max2746.000-2734.000=12.000
mean28.137-28.140=-0.003
σ0.048-0.093=-0.045
min28.094-28.028=0.066
max28.188-28.243=-0.055