Compare commits

Home / Compare 1ca1c142 .. e2b2cc3b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.783=-0.001
σ0.045-0.045=0.000
min70.746-70.752=-0.006
max70.907-70.906=0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.159-0.160=-0.001
σ0.004-0.004=0.001
min0.151-0.156=-0.005
max0.165-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.003-0.003=-0.000
min21.489-21.488=0.001
max21.498-21.496=0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.061=0.005
σ0.002-0.002=-0.000
min0.064-0.059=0.006
max0.072-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.095=-0.003
σ0.360-0.361=-0.001
min1753.535-1753.526=0.009
max1754.663-1754.678=-0.015
mean1649.200-1665.950=-16.750
σ640.049-631.207=8.843
min638.000-675.000=-37.000
max2850.000-2705.000=145.000
mean2.801-2.852=-0.051
σ0.241-0.137=0.103
min2.126-2.566=-0.441
max3.142-3.137=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.959-271.928=0.031
σ0.005-0.006=-0.001
min271.952-271.920=0.032
max271.966-271.935=0.031
mean2850.000-2705.000=145.000
σ0.000
min2850.000-2705.000=145.000
max2850.000-2705.000=145.000
mean0.384-0.378=0.005
σ0.006-0.001=0.005
min0.380-0.376=0.004
max0.395-0.380=0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.318-1932.324=-0.006
σ0.018-0.006=0.012
min1932.289-1932.317=-0.029
max1932.339-1932.332=0.007
mean2850.000-2705.000=145.000
σ0.000
min2850.000-2705.000=145.000
max2850.000-2705.000=145.000
mean3.011-3.060=-0.050
σ0.203-0.065=0.138
min2.737-3.005=-0.268
max3.275-3.152=0.123
iters=5
new-facts=6402
prior-facts=1
mean4753.050-4752.988=0.063
σ0.934-0.923=0.010
min4752.588-4752.150=0.438
max4754.719-4754.569=0.150
mean2850.000-2705.000=145.000
σ0.000
min2850.000-2705.000=145.000
max2850.000-2705.000=145.000
mean8.744-8.386=0.358
σ0.448-0.466=-0.017
min8.029-7.608=0.421
max9.090-8.848=0.242
iters=5
new-facts=6402
prior-facts=6402
mean4943.416-4943.489=-0.073
σ0.198-0.172=0.026
min4943.185-4943.182=0.003
max4943.575-4943.578=-0.003
mean3020.800-3007.400=13.400
σ191.419-241.663=-50.244
min2850.000-2705.000=145.000
max3316.000-3291.000=25.000
mean8.499-8.537=-0.038
σ0.094-0.154=-0.061
min8.395-8.385=0.009
max8.589-8.722=-0.133

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.079-1.092=-0.014
σ0.123-0.225=-0.103
min0.938-0.931=0.006
max1.277-1.417=-0.141

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.667-468.659=0.007
σ574.935-574.936=-0.001
min181.188-181.187=0.001
max1331.069-1331.063=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2850.000-2705.000=145.000
σ0.000
min2850.000-2705.000=145.000
max2850.000-2705.000=145.000
mean0.445-0.560=-0.114
σ0.303-0.539=-0.236
min0.291-0.287=0.005
max0.900-1.369=-0.469
policies=20
mean1812.229-1812.187=0.042
σ0.390-0.392=-0.002
min1811.949-1811.930=0.019
max1812.799-1812.767=0.031
mean840.000
σ0.000
min840.000
max840.000
mean2850.000-2705.000=145.000
σ0.000
min2850.000-2705.000=145.000
max2850.000-2705.000=145.000
mean2.907-2.832=0.075
σ0.029-0.013=0.016
min2.864-2.821=0.043
max2.929-2.851=0.078
policies=200
mean18129.083-18129.035=0.048
σ0.578-0.441=0.137
min18128.742-18128.727=0.015
max18129.948-18129.668=0.279
mean8400.000
σ0.000
min8400.000
max8400.000
mean2850.000-2705.000=145.000
σ0.000
min2850.000-2705.000=145.000
max2850.000-2705.000=145.000
mean28.942-28.497=0.445
σ0.567-0.058=0.509
min28.413-28.435=-0.022
max29.449-28.548=0.902