Compare commits

Home / Compare 81e48395 .. 32f466e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-70.702=2.344
σ0.049-0.047=0.002
min73.022-70.671=2.350
max73.184-70.831=2.352
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.161-0.161=0.000
σ0.003-0.004=-0.001
min0.158-0.158=0.000
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.740-21.408=2.332
σ0.003-0.004=-0.001
min23.734-21.405=2.329
max23.744-21.415=2.329
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.059-0.063=-0.005
max0.068-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1754.929=3.857
σ0.363-0.360=0.003
min1758.217-1754.362=3.855
max1759.371-1755.510=3.860
mean1659.800-1648.350=11.450
σ631.172-633.115=-1.943
min622.000-625.000=-3.000
max2892.000-2774.000=118.000
mean2.737-2.846=-0.109
σ0.212-0.169=0.043
min2.254-2.547=-0.293
max3.087-3.190=-0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.008-272.756=51.252
σ0.052-0.006=0.047
min323.915-272.749=51.166
max324.034-272.762=51.272
mean2892.000-2774.000=118.000
σ0.000
min2892.000-2774.000=118.000
max2892.000-2774.000=118.000
mean0.426-0.380=0.046
σ0.001-0.002=-0.001
min0.425-0.379=0.046
max0.427-0.383=0.044
iters=5
new-facts=1
prior-facts=6402
mean1984.579-1933.159=51.419
σ0.012-0.012=-0.000
min1984.568-1933.146=51.422
max1984.594-1933.178=51.416
mean2892.000-2774.000=118.000
σ0.000
min2892.000-2774.000=118.000
max2892.000-2774.000=118.000
mean2.608-3.094=-0.486
σ0.080-0.117=-0.037
min2.539-2.989=-0.450
max2.710-3.273=-0.563
iters=5
new-facts=6402
prior-facts=1
mean4808.118-4756.897=51.222
σ7.520-7.595=-0.075
min4804.738-4753.419=51.319
max4821.570-4770.482=51.088
mean2892.000-2774.000=118.000
σ0.000
min2892.000-2774.000=118.000
max2892.000-2774.000=118.000
mean8.761-8.711=0.051
σ0.164-0.290=-0.127
min8.612-8.334=0.278
max8.952-9.101=-0.149
iters=5
new-facts=6402
prior-facts=6402
mean4995.805-4944.252=51.553
σ0.016-0.187=-0.171
min4995.788-4944.047=51.741
max4995.819-4944.412=51.407
mean3020.800-2998.600=22.200
σ203.297-286.518=-83.221
min2892.000-2774.000=118.000
max3357.000-3434.000=-77.000
mean8.604-8.393=0.211
σ0.168-0.042=0.126
min8.462-8.360=0.102
max8.881-8.447=0.434

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.013-1.111=-0.097
σ0.143-0.272=-0.128
min0.911-0.918=-0.007
max1.247-1.502=-0.254

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.349-468.343=0.006
σ574.230-574.266=-0.036
min181.225-181.200=0.025
max1329.695-1329.743=-0.048
mean88.250
σ8.500
min84.000
max101.000
mean2892.000-2774.000=118.000
σ0.000
min2892.000-2774.000=118.000
max2892.000-2774.000=118.000
mean0.447-0.445=0.002
σ0.306-0.304=0.003
min0.290-0.290=-0.000
max0.906-0.900=0.005
policies=20
mean1812.619-1812.374=0.245
σ0.401-0.394=0.008
min1812.341-1812.102=0.239
max1813.210-1812.952=0.258
mean840.000
σ0.000
min840.000
max840.000
mean2892.000-2774.000=118.000
σ0.000
min2892.000-2774.000=118.000
max2892.000-2774.000=118.000
mean2.887-2.891=-0.004
σ0.017-0.010=0.007
min2.862-2.879=-0.017
max2.898-2.901=-0.003
policies=200
mean18132.175-18129.101=3.074
σ0.888-0.442=0.446
min18131.008-18128.707=2.301
max18132.919-18129.713=3.206
mean8400.000
σ0.000
min8400.000
max8400.000
mean2892.000-2774.000=118.000
σ0.000
min2892.000-2774.000=118.000
max2892.000-2774.000=118.000
mean28.831-28.559=0.272
σ0.341-0.224=0.116
min28.487-28.380=0.107
max29.135-28.877=0.258