Compare commits

Home / Compare 05aafc3e .. e82db652

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.678-70.561=0.117
σ0.046-0.046=-0.001
min70.656-70.540=0.116
max70.807-70.692=0.115
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.159-0.157=0.002
σ0.006-0.004=0.001
min0.152-0.150=0.002
max0.169-0.164=0.005
cache=y
dps=1
iters=10
policies=100
mean21.418-21.288=0.130
σ0.003-0.003=0.000
min21.412-21.284=0.128
max21.421-21.292=0.129
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.063-0.064=-0.001
σ0.003-0.002=0.001
min0.059-0.058=0.001
max0.069-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1753.375=1.082
σ0.362-0.360=0.001
min1753.879-1752.805=1.074
max1755.038-1753.961=1.078
mean1641.200-1662.250=-21.050
σ634.859-638.187=-3.329
min636.000-620.000=16.000
max2850.000-2812.000=38.000
mean2.837-2.843=-0.006
σ0.120-0.144=-0.024
min2.564-2.516=0.048
max3.069-3.133=-0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-271.755=1.751
σ0.005-0.009=-0.004
min273.498-271.744=1.754
max273.512-271.766=1.746
mean2850.000-2812.000=38.000
σ0.000
min2850.000-2812.000=38.000
max2850.000-2812.000=38.000
mean0.385-0.384=0.001
σ0.004-0.011=-0.007
min0.382-0.370=0.012
max0.392-0.400=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.889-1932.179=1.710
σ0.009-0.015=-0.006
min1933.876-1932.160=1.717
max1933.900-1932.197=1.703
mean2850.000-2812.000=38.000
σ0.000
min2850.000-2812.000=38.000
max2850.000-2812.000=38.000
mean3.034-2.929=0.105
σ0.065-0.152=-0.087
min2.954-2.726=0.228
max3.114-3.120=-0.006
iters=5
new-facts=6402
prior-facts=1
mean4754.628-4752.754=1.875
σ0.832-1.045=-0.213
min4754.153-4751.862=2.290
max4756.105-4754.566=1.540
mean2850.000-2812.000=38.000
σ0.000
min2850.000-2812.000=38.000
max2850.000-2812.000=38.000
mean8.690-8.958=-0.268
σ0.331-0.133=0.198
min8.227-8.796=-0.569
max9.086-9.146=-0.059
iters=5
new-facts=6402
prior-facts=6402
mean4945.116-4943.366=1.750
σ0.023-0.015=0.009
min4945.089-4943.348=1.742
max4945.142-4943.385=1.757
mean3047.400-3004.000=43.400
σ205.703-274.332=-68.629
min2850.000-2812.000=38.000
max3341.000-3446.000=-105.000
mean8.667-8.453=0.214
σ0.212-0.048=0.164
min8.439-8.408=0.031
max8.872-8.533=0.340

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.009=0.041
σ0.131-0.156=-0.025
min0.931-0.931=0.000
max1.253-1.289=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.571-467.866=4.704
σ574.924-575.935=-1.011
min185.101-179.890=5.211
max1334.957-1331.769=3.188
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2850.000-2812.000=38.000
σ0.000
min2850.000-2812.000=38.000
max2850.000-2812.000=38.000
mean0.452-0.557=-0.105
σ0.303-0.536=-0.233
min0.295-0.287=0.008
max0.907-1.361=-0.454
policies=20
mean1851.301-1799.151=52.150
σ0.371-0.351=0.020
min1851.033-1798.909=52.123
max1851.842-1799.666=52.176
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2850.000-2812.000=38.000
σ0.000
min2850.000-2812.000=38.000
max2850.000-2812.000=38.000
mean2.953-2.850=0.103
σ0.009-0.135=-0.126
min2.943-2.779=0.164
max2.963-3.053=-0.089
policies=200
mean18519.507-17998.407=521.101
σ0.430-0.576=-0.146
min18519.180-17997.991=521.188
max18520.138-17999.244=520.894
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2850.000-2812.000=38.000
σ0.000
min2850.000-2812.000=38.000
max2850.000-2812.000=38.000
mean29.205-28.158=1.046
σ0.405-0.152=0.252
min28.914-28.070=0.843
max29.803-28.386=1.417