Compare commits

Home / Compare d6195fec .. 15b75451

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.653-53.655=-0.002
σ0.367-0.369=-0.002
min53.514-53.515=-0.001
max54.698-54.704=-0.007
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.138-0.136=0.002
σ0.003-0.004=-0.001
min0.134-0.131=0.004
max0.144-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean42.980-42.981=-0.000
σ0.006-0.005=0.002
min42.972-42.976=-0.004
max42.992-42.990=0.002
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.119-0.119=0.000
σ0.005-0.004=0.001
min0.113-0.115=-0.002
max0.126-0.125=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.970-1013.970=-0.000
σ1.201-1.161=0.039
min1013.421-1013.426=-0.004
max1018.998-1018.822=0.176
mean1048.150-1053.850=-5.700
σ318.884-316.506=2.378
min555.000-589.000=-34.000
max1653.000-1657.000=-4.000
mean1.657-1.636=0.021
σ0.092-0.087=0.005
min1.561-1.511=0.050
max1.862-1.875=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.051-299.072=-0.022
σ0.200-0.204=-0.004
min298.861-298.945=-0.083
max299.566-299.639=-0.073
mean1967.000-1959.000=8.000
σ0.000
min1967.000-1959.000=8.000
max1967.000-1959.000=8.000
mean0.574-0.608=-0.034
σ0.019-0.025=-0.005
min0.553-0.573=-0.021
max0.600-0.661=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.674-294.676=-0.002
σ0.015-0.012=0.003
min294.653-294.657=-0.004
max294.694-294.689=0.006
mean1653.000-1657.000=-4.000
σ0.000
min1653.000-1657.000=-4.000
max1653.000-1657.000=-4.000
mean0.386-0.386=0.000
σ0.009-0.007=0.002
min0.379-0.381=-0.002
max0.397-0.395=0.003
iters=5
new-facts=1
prior-facts=6402
mean1316.989-1316.942=0.047
σ0.059-0.097=-0.038
min1316.903-1316.888=0.015
max1317.043-1317.114=-0.071
mean1653.000-1657.000=-4.000
σ0.000
min1653.000-1657.000=-4.000
max1653.000-1657.000=-4.000
mean2.049-1.950=0.100
σ0.200-0.090=0.110
min1.848-1.853=-0.005
max2.326-2.058=0.268
iters=5
new-facts=6402
prior-facts=1
mean1555.316-1555.323=-0.007
σ6.818-6.851=-0.033
min1552.074-1551.985=0.089
max1567.509-1567.573=-0.064
mean1653.000-1657.000=-4.000
σ0.000
min1653.000-1657.000=-4.000
max1653.000-1657.000=-4.000
mean2.273-2.396=-0.122
σ0.100-0.294=-0.194
min2.178-2.067=0.111
max2.430-2.691=-0.262
iters=5
new-facts=6402
prior-facts=6402
mean1884.773-1884.774=-0.002
σ0.031-0.040=-0.009
min1884.754-1884.739=0.015
max1884.828-1884.844=-0.016
mean1771.800-1800.800=-29.000
σ129.643-151.856=-22.213
min1653.000-1657.000=-4.000
max1967.000-1959.000=8.000
mean3.028-3.013=0.014
σ0.168-0.124=0.044
min2.878-2.883=-0.004
max3.274-3.208=0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.196-1.176=0.020
σ0.335-0.392=-0.057
min0.902-0.910=-0.008
max1.724-1.838=-0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.488-440.573=-0.084
σ573.034-573.034=-0.000
min153.967-154.044=-0.077
max1300.039-1300.124=-0.084
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1657.000=-4.000
σ0.000
min1653.000-1657.000=-4.000
max1653.000-1657.000=-4.000
mean0.542-0.556=-0.015
σ0.563-0.572=-0.009
min0.258-0.263=-0.004
max1.386-1.415=-0.028
policies=20
mean1539.848-1540.691=-0.843
σ0.305-0.306=-0.001
min1539.667-1540.518=-0.851
max1540.304-1541.150=-0.846
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1657.000=-4.000
σ0.000
min1653.000-1657.000=-4.000
max1653.000-1657.000=-4.000
mean2.584-2.592=-0.008
σ0.019-0.018=0.001
min2.560-2.569=-0.009
max2.600-2.606=-0.006
policies=200
mean15406.396-15414.848=-8.452
σ0.184-0.066=0.118
min15406.214-15414.757=-8.543
max15406.652-15414.900=-8.249
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1657.000=-4.000
σ0.000
min1653.000-1657.000=-4.000
max1653.000-1657.000=-4.000
mean26.134-26.197=-0.064
σ0.138-0.158=-0.021
min25.980-26.020=-0.040
max26.272-26.362=-0.090