Compare commits

Home / Compare 9c2781d5 .. 8d0f5ad7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.708-53.713=-0.005
σ0.365-0.364=0.000
min53.576-53.575=0.001
max54.745-54.749=-0.004
mean416.000-414.400=1.600
σ0.000-0.966=-0.966
min416.000-413.000=3.000
max416.000-415.000=1.000
mean0.137-0.151=-0.015
σ0.005-0.010=-0.005
min0.130-0.135=-0.005
max0.146-0.166=-0.020
cache=y
dps=1
iters=10
policies=100
mean42.977-42.979=-0.002
σ0.006-0.006=-0.000
min42.965-42.970=-0.005
max42.987-42.990=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.118-0.121=-0.003
σ0.003-0.004=-0.001
min0.114-0.118=-0.004
max0.124-0.127=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.533-1017.536=-0.003
σ1.206-1.208=-0.002
min1017.000-1016.999=0.001
max1022.582-1022.593=-0.011
mean1064.800-1051.000=13.800
σ312.594-307.904=4.690
min606.000-592.000=14.000
max1640.000-1505.000=135.000
mean1.547-1.594=-0.047
σ0.042-0.158=-0.116
min1.503-1.484=0.019
max1.621-2.238=-0.616

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean337.531-337.494=0.037
σ0.252-0.268=-0.017
min337.312-337.295=0.017
max338.188-338.196=-0.008
mean2114.000-1983.000=131.000
σ0.000
min2114.000-1983.000=131.000
max2114.000-1983.000=131.000
mean0.818-0.812=0.007
σ0.048-0.050=-0.002
min0.696-0.710=-0.015
max0.849-0.857=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.581-297.583=-0.002
σ0.026-0.007=0.019
min297.537-297.572=-0.036
max297.606-297.592=0.014
mean1640.000-1505.000=135.000
σ0.000
min1640.000-1505.000=135.000
max1640.000-1505.000=135.000
mean0.396-0.384=0.012
σ0.010-0.022=-0.012
min0.386-0.347=0.040
max0.410-0.400=0.010
iters=5
new-facts=1
prior-facts=6402
mean1320.528-1320.542=-0.014
σ0.072-0.089=-0.016
min1320.410-1320.386=0.024
max1320.595-1320.605=-0.010
mean1640.000-1505.000=135.000
σ0.000
min1640.000-1505.000=135.000
max1640.000-1505.000=135.000
mean2.009-1.946=0.063
σ0.243-0.080=0.163
min1.845-1.857=-0.012
max2.430-2.013=0.417
iters=5
new-facts=6402
prior-facts=1
mean1740.712-1740.706=0.005
σ6.929-6.911=0.019
min1737.505-1737.515=-0.010
max1753.103-1753.065=0.038
mean1640.000-1505.000=135.000
σ0.000
min1640.000-1505.000=135.000
max1640.000-1505.000=135.000
mean3.226-3.029=0.197
σ0.252-0.359=-0.108
min2.997-2.703=0.294
max3.565-3.641=-0.076
iters=5
new-facts=6402
prior-facts=6402
mean2003.497-2003.444=0.053
σ0.013-0.046=-0.033
min2003.482-2003.378=0.104
max2003.515-2003.482=0.033
mean1854.800-1782.200=72.600
σ191.316-216.862=-25.546
min1640.000-1505.000=135.000
max2114.000-1983.000=131.000
mean3.336-3.237=0.099
σ0.155-0.070=0.085
min3.132-3.160=-0.028
max3.540-3.303=0.237

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-1.578=-0.508
σ0.169-0.219=-0.050
min0.930-1.231=-0.301
max1.364-1.812=-0.448

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean441.107-441.092=0.015
σ573.029-573.027=0.003
min154.582-154.571=0.012
max1300.651-1300.632=0.019
mean94.250
σ8.500
min90.000
max107.000
mean1640.000-1505.000=135.000
σ0.000
min1640.000-1505.000=135.000
max1640.000-1505.000=135.000
mean0.525-0.550=-0.025
σ0.525-0.575=-0.050
min0.261-0.260=0.000
max1.313-1.413=-0.100
policies=20
mean1546.061-1546.037=0.024
σ0.347-0.336=0.011
min1545.849-1545.823=0.026
max1546.580-1546.538=0.041
mean900.000
σ0.000
min900.000
max900.000
mean1640.000-1505.000=135.000
σ0.000
min1640.000-1505.000=135.000
max1640.000-1505.000=135.000
mean2.655-2.637=0.017
σ0.018-0.043=-0.025
min2.639-2.597=0.042
max2.672-2.684=-0.012
policies=200
mean15468.208-15468.229=-0.021
σ0.091-0.073=0.018
min15468.140-15468.127=0.013
max15468.336-15468.287=0.049
mean9000.000
σ0.000
min9000.000
max9000.000
mean1640.000-1505.000=135.000
σ0.000
min1640.000-1505.000=135.000
max1640.000-1505.000=135.000
mean26.699-26.664=0.035
σ0.086-0.148=-0.062
min26.624-26.482=0.142
max26.778-26.813=-0.035