Compare commits

Home / Compare 45ada4de .. b8448263

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.782=-0.080
σ0.047-0.053=-0.006
min70.669-70.753=-0.084
max70.831-70.930=-0.098
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.162-0.159=0.002
σ0.003-0.004=-0.000
min0.159-0.156=0.003
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.492=-0.085
σ0.002-0.002=-0.000
min21.404-21.489=-0.085
max21.410-21.495=-0.085
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.062-0.063=-0.000
σ0.003-0.003=-0.000
min0.059-0.059=-0.000
max0.066-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1751.881=3.049
σ0.362-0.359=0.003
min1754.359-1751.318=3.041
max1755.517-1752.468=3.049
mean1657.050-1661.050=-4.000
σ619.488-633.240=-13.752
min686.000-696.000=-10.000
max2775.000-2852.000=-77.000
mean2.816-2.824=-0.008
σ0.143-0.149=-0.006
min2.330-2.429=-0.100
max3.034-3.027=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.755-269.381=3.374
σ0.003-0.005=-0.002
min272.753-269.376=3.377
max272.760-269.386=3.374
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean0.384-0.377=0.007
σ0.008-0.004=0.004
min0.379-0.374=0.005
max0.398-0.383=0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.159-1929.748=3.411
σ0.018-0.006=0.012
min1933.141-1929.741=3.399
max1933.183-1929.755=3.428
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean2.968-3.066=-0.098
σ0.362-0.117=0.245
min2.472-2.935=-0.463
max3.396-3.239=0.157
iters=5
new-facts=6402
prior-facts=1
mean4756.911-4750.475=6.436
σ7.589-0.867=6.722
min4753.446-4750.006=3.440
max4770.486-4752.020=18.466
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean8.618-8.606=0.012
σ0.218-0.434=-0.216
min8.366-8.019=0.347
max8.961-9.083=-0.123
iters=5
new-facts=6402
prior-facts=6402
mean4944.392-4940.987=3.405
σ0.023-0.019=0.005
min4944.366-4940.961=3.405
max4944.423-4941.006=3.417
mean3037.400-3070.600=-33.200
σ323.120-234.354=88.766
min2775.000-2852.000=-77.000
max3525.000-3417.000=108.000
mean8.450-8.701=-0.251
σ0.128-0.217=-0.089
min8.337-8.413=-0.076
max8.666-8.950=-0.284

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.080=-0.074
σ0.135-0.265=-0.130
min0.916-0.930=-0.014
max1.226-1.545=-0.318

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.344-462.701=5.643
σ574.255-574.944=-0.690
min181.207-175.224=5.983
max1329.726-1325.118=4.608
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean0.447-0.481=-0.034
σ0.307-0.388=-0.081
min0.292-0.283=0.008
max0.907-1.064=-0.156
policies=20
mean1812.380-1752.523=59.857
σ0.393-0.374=0.018
min1812.104-1752.261=59.842
max1812.957-1753.077=59.880
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean2.884-2.813=0.071
σ0.009-0.007=0.002
min2.878-2.805=0.072
max2.896-2.822=0.074
policies=200
mean18129.054-17532.334=596.720
σ0.344-0.499=-0.155
min18128.731-17532.039=596.691
max18129.503-17533.079=596.423
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2775.000-2852.000=-77.000
σ0.000
min2775.000-2852.000=-77.000
max2775.000-2852.000=-77.000
mean28.471-27.889=0.582
σ0.236-0.510=-0.274
min28.258-27.417=0.841
max28.722-28.365=0.357