Compare commits

Home / Compare db07b679 .. ccd97667

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.917-53.915=0.002
σ0.368-0.365=0.003
min53.792-53.780=0.012
max54.964-54.953=0.011
mean414.000
σ0.000
min414.000
max414.000
mean0.146-0.139=0.006
σ0.011-0.005=0.007
min0.136-0.134=0.002
max0.167-0.148=0.020
cache=y
dps=1
iters=10
policies=100
mean43.141-43.142=-0.001
σ0.007-0.007=0.000
min43.130-43.132=-0.002
max43.153-43.154=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.120-0.121=-0.001
σ0.003-0.003=-0.000
min0.117-0.118=-0.001
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.078-992.079=-0.001
σ1.231-1.247=-0.016
min991.496-991.498=-0.002
max997.251-997.324=-0.073
mean1064.300-1072.650=-8.350
σ321.523-324.824=-3.301
min602.000
max1635.000-1643.000=-8.000
mean1.558-1.525=0.033
σ0.140-0.072=0.068
min1.416-1.419=-0.003
max1.998-1.751=0.246

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.675-285.674=0.001
σ0.014-0.011=0.002
min285.653-285.655=-0.002
max285.686-285.685=0.001
mean1635.000-1643.000=-8.000
σ0.000
min1635.000-1643.000=-8.000
max1635.000-1643.000=-8.000
mean0.379-0.375=0.004
σ0.008-0.002=0.006
min0.373-0.373=0.000
max0.393-0.378=0.015
iters=5
new-facts=1
prior-facts=6402
mean1285.642-1285.639=0.003
σ0.134-0.136=-0.002
min1285.580-1285.574=0.006
max1285.881-1285.882=-0.000
mean1635.000-1643.000=-8.000
σ0.000
min1635.000-1643.000=-8.000
max1635.000-1643.000=-8.000
mean1.927-1.920=0.007
σ0.141-0.093=0.048
min1.819-1.843=-0.025
max2.167-2.079=0.088
iters=5
new-facts=6402
prior-facts=1
mean1807.970-1807.971=-0.001
σ7.015-7.003=0.012
min1804.614-1804.636=-0.022
max1820.504-1820.484=0.020
mean1635.000-1643.000=-8.000
σ0.000
min1635.000-1643.000=-8.000
max1635.000-1643.000=-8.000
mean4.168-4.150=0.019
σ0.205-0.085=0.120
min3.966-4.059=-0.093
max4.423-4.288=0.135
iters=5
new-facts=6402
prior-facts=6402
mean2070.467-2070.467=-0.000
σ0.007-0.012=-0.005
min2070.460-2070.455=0.005
max2070.478-2070.486=-0.009
mean1835.400-1841.600=-6.200
σ174.456-175.823=-1.367
min1635.000-1643.000=-8.000
max2072.000-2077.000=-5.000
mean4.540-4.554=-0.014
σ0.033-0.061=-0.028
min4.498-4.474=0.024
max4.587-4.636=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.296-1.288=0.009
σ0.353-0.265=0.088
min0.904-0.913=-0.009
max1.705-1.532=0.174

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.382-437.377=0.005
σ572.362-572.360=0.002
min151.196-151.190=0.006
max1295.925-1295.918=0.007
mean90.250
σ8.500
min86.000
max103.000
mean1635.000-1643.000=-8.000
σ0.000
min1635.000-1643.000=-8.000
max1635.000-1643.000=-8.000
mean0.553-0.511=0.042
σ0.592-0.519=0.073
min0.253-0.250=0.003
max1.442-1.290=0.152
policies=20
mean1512.205-1512.194=0.011
σ0.246-0.256=-0.011
min1512.042-1512.023=0.018
max1512.571-1512.575=-0.005
mean860.000
σ0.000
min860.000
max860.000
mean1635.000-1643.000=-8.000
σ0.000
min1635.000-1643.000=-8.000
max1635.000-1643.000=-8.000
mean2.526-2.531=-0.005
σ0.018-0.019=-0.001
min2.503-2.513=-0.010
max2.546-2.556=-0.010
policies=200
mean15129.691-15129.694=-0.003
σ0.069-0.061=0.008
min15129.612-15129.614=-0.002
max15129.780-15129.763=0.016
mean8600.000
σ0.000
min8600.000
max8600.000
mean1635.000-1643.000=-8.000
σ0.000
min1635.000-1643.000=-8.000
max1635.000-1643.000=-8.000
mean25.677-25.708=-0.031
σ0.241-0.296=-0.055
min25.447-25.457=-0.010
max25.994-26.130=-0.136