Compare commits

Home / Compare 596b7480 .. 8051f91a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.047=-0.002
σ0.047-0.050=-0.003
min73.020-73.018=0.002
max73.178-73.187=-0.009
mean415.000-413.400=1.600
σ0.000-0.516=-0.516
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.158-0.158=-0.001
σ0.006-0.005=0.001
min0.148-0.152=-0.004
max0.169-0.165=0.005
cache=y
dps=1
iters=10
policies=100
mean23.740-23.741=-0.001
σ0.002-0.003=-0.001
min23.738-23.737=0.001
max23.745-23.747=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.066=0.000
σ0.003-0.002=0.001
min0.064-0.064=-0.001
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.789=-0.003
σ0.359-0.361=-0.003
min1758.222-1758.223=-0.002
max1759.368-1759.374=-0.006
mean1655.600-1631.550=24.050
σ623.621-609.597=14.024
min631.000-637.000=-6.000
max2510.000-2438.000=72.000
mean2.782-2.848=-0.066
σ0.155-0.182=-0.028
min2.374-2.250=0.124
max2.966-3.195=-0.229

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.013-324.013=0.001
σ0.060-0.060=-0.000
min323.906-323.905=0.001
max324.045-324.043=0.002
mean2510.000-2438.000=72.000
σ0.000
min2510.000-2438.000=72.000
max2510.000-2438.000=72.000
mean0.430-0.428=0.002
σ0.004-0.004=-0.000
min0.427-0.424=0.003
max0.437-0.435=0.002
iters=5
new-facts=1
prior-facts=6402
mean1984.595-1984.585=0.011
σ0.012-0.021=-0.009
min1984.574-1984.552=0.022
max1984.603-1984.601=0.001
mean2510.000-2438.000=72.000
σ0.000
min2510.000-2438.000=72.000
max2510.000-2438.000=72.000
mean2.645-2.636=0.009
σ0.138-0.136=0.002
min2.518-2.560=-0.041
max2.859-2.878=-0.020
iters=5
new-facts=6402
prior-facts=1
mean4808.026-4808.244=-0.218
σ7.982-7.778=0.204
min4804.243-4804.726=-0.483
max4822.299-4822.157=0.142
mean2510.000-2438.000=72.000
σ0.000
min2510.000-2438.000=72.000
max2510.000-2438.000=72.000
mean9.034-8.746=0.288
σ0.258-0.142=0.116
min8.746-8.519=0.227
max9.423-8.886=0.537
iters=5
new-facts=6402
prior-facts=6402
mean4995.801-4995.658=0.143
σ0.019-0.206=-0.186
min4995.783-4995.421=0.362
max4995.822-4995.827=-0.004
mean3006.000-2947.600=58.400
σ316.667-457.170=-140.503
min2596.000-2438.000=158.000
max3415.000-3568.000=-153.000
mean8.714-8.511=0.203
σ0.124-0.138=-0.013
min8.550-8.381=0.169
max8.878-8.733=0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.646-1.715=-0.069
σ0.176-0.064=0.112
min1.370-1.614=-0.245
max1.796-1.787=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.325-468.326=-0.000
σ574.231-574.229=0.002
min181.205-181.204=0.001
max1329.672-1329.669=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2510.000-2438.000=72.000
σ0.000
min2510.000-2438.000=72.000
max2510.000-2438.000=72.000
mean0.540-0.578=-0.038
σ0.517-0.584=-0.066
min0.274-0.280=-0.006
max1.316-1.453=-0.137
policies=20
mean1812.405-1812.419=-0.014
σ0.395-0.384=0.010
min1812.144-1812.166=-0.022
max1812.989-1812.988=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2510.000-2438.000=72.000
σ0.000
min2510.000-2438.000=72.000
max2510.000-2438.000=72.000
mean2.820-2.815=0.006
σ0.012-0.005=0.007
min2.811-2.808=0.003
max2.837-2.819=0.018
policies=200
mean18131.611-18131.552=0.059
σ0.532-0.501=0.031
min18131.305-18131.266=0.039
max18132.408-18132.299=0.109
mean8400.000
σ0.000
min8400.000
max8400.000
mean2510.000-2438.000=72.000
σ0.000
min2510.000-2438.000=72.000
max2510.000-2438.000=72.000
mean28.321-28.375=-0.054
σ0.159-0.085=0.074
min28.201-28.278=-0.077
max28.554-28.484=0.069