Compare commits

Home / Compare c347d423 .. 787ab025

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.652=0.003
σ0.369-0.367=0.002
min53.515-53.512=0.003
max54.704-54.696=0.009
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.136-0.135=0.002
σ0.004-0.004=-0.000
min0.131-0.131=-0.000
max0.142-0.143=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.000
σ0.005-0.007=-0.002
min42.976-42.970=0.006
max42.990-42.992=-0.001
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.119-0.119=0.000
σ0.004-0.005=-0.001
min0.115-0.114=0.001
max0.125-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.970-1013.971=-0.001
σ1.161-1.172=-0.011
min1013.426-1013.427=-0.001
max1018.822-1018.868=-0.046
mean1053.850-1048.900=4.950
σ316.506-316.324=0.181
min589.000-584.000=5.000
max1657.000-1653.000=4.000
mean1.636-1.621=0.015
σ0.087-0.084=0.003
min1.511-1.481=0.030
max1.875-1.889=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.072-299.096=-0.024
σ0.204-0.204=0.000
min298.945-298.946=-0.002
max299.639-299.656=-0.017
mean1959.000
σ0.000
min1959.000
max1959.000
mean0.608-0.578=0.030
σ0.025-0.024=0.001
min0.573-0.548=0.026
max0.661-0.619=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.676-294.678=-0.002
σ0.012-0.011=0.000
min294.657-294.664=-0.007
max294.689-294.695=-0.007
mean1657.000-1653.000=4.000
σ0.000
min1657.000-1653.000=4.000
max1657.000-1653.000=4.000
mean0.386-0.388=-0.002
σ0.007-0.007=0.000
min0.381-0.380=0.001
max0.395-0.393=0.002
iters=5
new-facts=1
prior-facts=6402
mean1316.942-1316.933=0.010
σ0.097-0.091=0.006
min1316.888-1316.888=-0.000
max1317.114-1317.095=0.019
mean1657.000-1653.000=4.000
σ0.000
min1657.000-1653.000=4.000
max1657.000-1653.000=4.000
mean1.950-1.895=0.055
σ0.090-0.056=0.034
min1.853-1.856=-0.003
max2.058-1.993=0.065
iters=5
new-facts=6402
prior-facts=1
mean1555.323-1555.299=0.025
σ6.851-6.893=-0.042
min1551.985-1551.991=-0.006
max1567.573-1567.624=-0.051
mean1657.000-1653.000=4.000
σ0.000
min1657.000-1653.000=4.000
max1657.000-1653.000=4.000
mean2.396-2.335=0.060
σ0.294-0.327=-0.033
min2.067-2.139=-0.072
max2.691-2.915=-0.223
iters=5
new-facts=6402
prior-facts=6402
mean1884.774-1884.771=0.003
σ0.040-0.016=0.025
min1884.739-1884.756=-0.017
max1884.844-1884.793=0.051
mean1800.800-1741.600=59.200
σ151.856-135.236=16.620
min1657.000-1653.000=4.000
max1959.000
mean3.013-2.910=0.103
σ0.124-0.119=0.004
min2.883-2.831=0.052
max3.208-3.120=0.088

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.176-1.180=-0.003
σ0.392-0.329=0.064
min0.910-0.905=0.005
max1.838-1.731=0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.573-440.569=0.003
σ573.034-573.035=-0.001
min154.044-154.048=-0.005
max1300.124-1300.122=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1657.000-1653.000=4.000
σ0.000
min1657.000-1653.000=4.000
max1657.000-1653.000=4.000
mean0.556-0.541=0.015
σ0.572-0.547=0.026
min0.263-0.268=-0.005
max1.415-1.361=0.054
policies=20
mean1540.691-1540.690=0.001
σ0.306-0.305=0.001
min1540.518-1540.517=0.001
max1541.150-1541.148=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1657.000-1653.000=4.000
σ0.000
min1657.000-1653.000=4.000
max1657.000-1653.000=4.000
mean2.592-2.584=0.008
σ0.018-0.008=0.010
min2.569-2.576=-0.007
max2.606-2.595=0.011
policies=200
mean15414.848-15414.837=0.011
σ0.066-0.063=0.003
min15414.757-15414.800=-0.044
max15414.900-15414.931=-0.031
mean9200.000
σ0.000
min9200.000
max9200.000
mean1657.000-1653.000=4.000
σ0.000
min1657.000-1653.000=4.000
max1657.000-1653.000=4.000
mean26.197-26.111=0.086
σ0.158-0.120=0.039
min26.020-25.981=0.039
max26.362-26.255=0.107