Compare commits

Home / Compare a90496b1 .. 2009d17a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.653-53.656=-0.003
σ0.367-0.369=-0.002
min53.514-53.516=-0.002
max54.698-54.706=-0.008
mean416.000
σ0.000
min416.000
max416.000
mean0.138-0.138=-0.000
σ0.003-0.003=0.000
min0.134-0.135=-0.001
max0.144-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.980-42.982=-0.001
σ0.006-0.006=0.000
min42.972-42.972=-0.001
max42.992-42.995=-0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.119-0.119=0.000
σ0.005-0.003=0.002
min0.113-0.114=-0.001
max0.126-0.122=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.970-1013.968=0.002
σ1.201-1.174=0.026
min1013.421-1013.431=-0.009
max1018.998-1018.882=0.116
mean1048.150-1049.600=-1.450
σ318.884-317.967=0.917
min555.000-600.000=-45.000
max1653.000-1655.000=-2.000
mean1.657-1.600=0.057
σ0.092-0.074=0.018
min1.561-1.525=0.035
max1.862-1.812=0.050

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.051-299.158=-0.107
σ0.200-0.192=0.008
min298.861-299.028=-0.167
max299.566-299.675=-0.109
mean1967.000-1960.000=7.000
σ0.000
min1967.000-1960.000=7.000
max1967.000-1960.000=7.000
mean0.574-0.579=-0.005
σ0.019-0.024=-0.004
min0.553-0.553=-0.001
max0.600-0.615=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.674-294.677=-0.003
σ0.015-0.013=0.002
min294.653-294.656=-0.003
max294.694-294.689=0.005
mean1653.000-1655.000=-2.000
σ0.000
min1653.000-1655.000=-2.000
max1653.000-1655.000=-2.000
mean0.386-0.377=0.009
σ0.009-0.006=0.003
min0.379-0.372=0.006
max0.397-0.386=0.011
iters=5
new-facts=1
prior-facts=6402
mean1316.989-1316.931=0.058
σ0.059-0.103=-0.044
min1316.903-1316.871=0.031
max1317.043-1317.114=-0.071
mean1653.000-1655.000=-2.000
σ0.000
min1653.000-1655.000=-2.000
max1653.000-1655.000=-2.000
mean2.049-1.888=0.161
σ0.200-0.074=0.125
min1.848-1.802=0.046
max2.326-1.985=0.341
iters=5
new-facts=6402
prior-facts=1
mean1555.316-1555.291=0.025
σ6.818-6.851=-0.033
min1552.074-1551.972=0.102
max1567.509-1567.541=-0.032
mean1653.000-1655.000=-2.000
σ0.000
min1653.000-1655.000=-2.000
max1653.000-1655.000=-2.000
mean2.273-2.272=0.002
σ0.100-0.221=-0.121
min2.178-2.136=0.042
max2.430-2.658=-0.228
iters=5
new-facts=6402
prior-facts=6402
mean1884.773-1884.780=-0.007
σ0.031-0.028=0.002
min1884.754-1884.753=0.002
max1884.828-1884.826=0.002
mean1771.800-1743.600=28.200
σ129.643-134.925=-5.283
min1653.000-1655.000=-2.000
max1967.000-1960.000=7.000
mean3.028-2.934=0.094
σ0.168-0.069=0.098
min2.878-2.872=0.006
max3.274-3.014=0.259

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.196-1.171=0.025
σ0.335-0.292=0.044
min0.902-0.918=-0.016
max1.724-1.652=0.071

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.488-440.568=-0.080
σ573.034-573.038=-0.004
min153.967-154.048=-0.081
max1300.039-1300.125=-0.086
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1655.000=-2.000
σ0.000
min1653.000-1655.000=-2.000
max1653.000-1655.000=-2.000
mean0.542-0.549=-0.007
σ0.563-0.557=0.006
min0.258-0.266=-0.008
max1.386-1.385=0.002
policies=20
mean1539.848-1540.684=-0.836
σ0.305-0.312=-0.007
min1539.667-1540.507=-0.841
max1540.304-1541.152=-0.847
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1655.000=-2.000
σ0.000
min1653.000-1655.000=-2.000
max1653.000-1655.000=-2.000
mean2.584-2.593=-0.010
σ0.019-0.021=-0.002
min2.560-2.571=-0.012
max2.600-2.617=-0.017
policies=200
mean15406.396-15414.651=-8.255
σ0.184-0.136=0.047
min15406.214-15414.528=-8.314
max15406.652-15414.846=-8.194
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1655.000=-2.000
σ0.000
min1653.000-1655.000=-2.000
max1653.000-1655.000=-2.000
mean26.134-26.260=-0.126
σ0.138-0.183=-0.046
min25.980-26.068=-0.088
max26.272-26.485=-0.213