Compare commits

Home / Compare 7a81e9e2 .. 9b7743c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.782=-0.000
σ0.046-0.049=-0.003
min70.747-70.750=-0.004
max70.909-70.918=-0.009
mean411.500-414.000=-2.500
σ0.527-0.000=0.527
min411.000-414.000=-3.000
max412.000-414.000=-2.000
mean0.161-0.160=0.000
σ0.003-0.005=-0.002
min0.158-0.154=0.003
max0.165-0.169=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.003-0.003=-0.000
min21.489-21.488=0.002
max21.497-21.496=0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.066-0.064=0.002
σ0.002-0.003=-0.001
min0.065-0.059=0.005
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.001
σ0.358-0.360=-0.001
min1753.537-1753.526=0.011
max1754.666-1754.673=-0.007
mean1637.550-1662.650=-25.100
σ617.912-629.756=-11.844
min641.000-677.000=-36.000
max2476.000-2688.000=-212.000
mean2.821-2.822=-0.002
σ0.187-0.167=0.020
min2.446-2.451=-0.005
max3.222-3.118=0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.600-271.599=0.000
σ0.004-0.008=-0.004
min271.593-271.588=0.005
max271.605-271.607=-0.002
mean2476.000-2688.000=-212.000
σ0.000
min2476.000-2688.000=-212.000
max2476.000-2688.000=-212.000
mean0.383-0.386=-0.003
σ0.004-0.006=-0.002
min0.378-0.382=-0.003
max0.389-0.393=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1931.995-1931.979=0.016
σ0.019-0.017=0.002
min1931.962-1931.961=0.001
max1932.007-1932.003=0.004
mean2476.000-2688.000=-212.000
σ0.000
min2476.000-2688.000=-212.000
max2476.000-2688.000=-212.000
mean2.496-2.545=-0.049
σ0.044-0.153=-0.109
min2.461-2.409=0.053
max2.564-2.806=-0.242
iters=5
new-facts=6402
prior-facts=1
mean4752.728-4752.696=0.032
σ0.853-0.936=-0.082
min4752.223-4752.176=0.048
max4754.248-4754.363=-0.115
mean2476.000-2688.000=-212.000
σ0.000
min2476.000-2688.000=-212.000
max2476.000-2688.000=-212.000
mean8.700-8.859=-0.159
σ0.327-0.415=-0.088
min8.367-8.230=0.138
max9.149-9.398=-0.250
iters=5
new-facts=6402
prior-facts=6402
mean4943.133-4943.207=-0.074
σ0.166-0.016=0.149
min4942.839-4943.181=-0.342
max4943.225-4943.223=0.002
mean3013.000-2970.400=42.600
σ262.225-240.822=21.403
min2622.000-2688.000=-66.000
max3324.000-3305.000=19.000
mean8.632-8.453=0.179
σ0.249-0.103=0.146
min8.393-8.361=0.032
max8.904-8.624=0.280

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.737-1.223=0.514
σ0.138-0.247=-0.108
min1.563-0.935=0.628
max1.912-1.562=0.350

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.627-468.641=-0.014
σ574.920-574.948=-0.028
min181.163-181.162=0.001
max1331.007-1331.064=-0.057
mean88.250
σ8.500
min84.000
max101.000
mean2476.000-2688.000=-212.000
σ0.000
min2476.000-2688.000=-212.000
max2476.000-2688.000=-212.000
mean0.558-0.572=-0.014
σ0.534-0.566=-0.032
min0.288-0.286=0.002
max1.359-1.421=-0.062
policies=20
mean1811.940-1811.972=-0.031
σ0.399-0.391=0.008
min1811.666-1811.698=-0.032
max1812.526-1812.547=-0.021
mean840.000
σ0.000
min840.000
max840.000
mean2476.000-2688.000=-212.000
σ0.000
min2476.000-2688.000=-212.000
max2476.000-2688.000=-212.000
mean2.852-2.850=0.002
σ0.013-0.018=-0.005
min2.837-2.829=0.008
max2.865-2.871=-0.006
policies=200
mean18126.654-18126.658=-0.004
σ0.390-0.488=-0.098
min18126.319-18126.276=0.043
max18127.216-18127.355=-0.138
mean8400.000
σ0.000
min8400.000
max8400.000
mean2476.000-2688.000=-212.000
σ0.000
min2476.000-2688.000=-212.000
max2476.000-2688.000=-212.000
mean28.605-28.699=-0.094
σ0.092-0.108=-0.015
min28.492-28.599=-0.108
max28.682-28.809=-0.128