Compare commits

Home / Compare f2141eaa .. b9c07f23

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.701=0.000
σ0.045-0.046=-0.001
min70.675-70.666=0.009
max70.827-70.829=-0.001
mean410.000-415.200=-5.200
σ0.000-0.422=-0.422
min410.000-415.000=-5.000
max410.000-416.000=-6.000
mean0.162-0.160=0.002
σ0.005-0.003=0.002
min0.156-0.157=-0.001
max0.174-0.165=0.008
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=0.001
σ0.003-0.003=0.001
min21.403-21.406=-0.003
max21.414-21.412=0.002
mean410.800-416.000=-5.200
σ0.422-0.000=0.422
min410.000-416.000=-6.000
max411.000-416.000=-5.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.000
min0.064-0.064=0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.897-1754.897=0.001
σ0.360-0.362=-0.002
min1754.331-1754.340=-0.009
max1755.479-1755.486=-0.007
mean1627.050-1631.400=-4.350
σ607.818-607.369=0.449
min627.000-632.000=-5.000
max2442.000-2445.000=-3.000
mean2.757-2.750=0.008
σ0.155-0.195=-0.040
min2.347-2.316=0.032
max2.945-3.066=-0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.731-272.762=-0.031
σ0.005-0.007=-0.002
min272.723-272.754=-0.030
max272.736-272.773=-0.037
mean2442.000-2445.000=-3.000
σ0.000
min2442.000-2445.000=-3.000
max2442.000-2445.000=-3.000
mean0.384-0.385=-0.000
σ0.001-0.001=-0.001
min0.384-0.383=0.001
max0.386-0.386=0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.131-1933.129=0.003
σ0.019-0.012=0.007
min1933.108-1933.112=-0.005
max1933.158-1933.147=0.012
mean2442.000-2445.000=-3.000
σ0.000
min2442.000-2445.000=-3.000
max2442.000-2445.000=-3.000
mean2.884-3.105=-0.221
σ0.273-0.093=0.180
min2.487-3.033=-0.546
max3.127-3.248=-0.120
iters=5
new-facts=6402
prior-facts=1
mean4753.682-4753.855=-0.173
σ0.714-0.952=-0.238
min4753.093-4753.348=-0.255
max4754.909-4755.557=-0.647
mean2442.000-2445.000=-3.000
σ0.000
min2442.000-2445.000=-3.000
max2442.000-2445.000=-3.000
mean8.460-8.782=-0.322
σ0.577-0.286=0.291
min7.756-8.344=-0.588
max9.083-9.099=-0.016
iters=5
new-facts=6402
prior-facts=6402
mean4944.364-4944.294=0.070
σ0.017-0.144=-0.127
min4944.341-4944.037=0.304
max4944.380-4944.373=0.007
mean2915.000-2905.800=9.200
σ316.704-383.284=-66.580
min2442.000-2445.000=-3.000
max3282.000-3422.000=-140.000
mean8.485-8.385=0.100
σ0.083-0.152=-0.070
min8.355-8.129=0.226
max8.551-8.535=0.016

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.660-1.682=-0.022
σ0.137-0.093=0.044
min1.489-1.547=-0.059
max1.803-1.802=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.999-469.002=-0.003
σ575.616-575.617=-0.002
min181.184-181.187=-0.003
max1332.423-1332.428=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2442.000-2445.000=-3.000
σ0.000
min2442.000-2445.000=-3.000
max2442.000-2445.000=-3.000
mean0.576-0.547=0.029
σ0.576-0.514=0.062
min0.285-0.288=-0.002
max1.440-1.318=0.122
policies=20
mean1812.181-1812.205=-0.024
σ0.391-0.390=0.001
min1811.918-1811.949=-0.031
max1812.757-1812.780=-0.024
mean840.000
σ0.000
min840.000
max840.000
mean2442.000-2445.000=-3.000
σ0.000
min2442.000-2445.000=-3.000
max2442.000-2445.000=-3.000
mean2.870-2.853=0.017
σ0.032-0.017=0.016
min2.841-2.833=0.008
max2.916-2.871=0.046
policies=200
mean18129.089-18129.059=0.030
σ0.405-0.590=-0.185
min18128.786-18128.691=0.095
max18129.684-18129.938=-0.254
mean8400.000
σ0.000
min8400.000
max8400.000
mean2442.000-2445.000=-3.000
σ0.000
min2442.000-2445.000=-3.000
max2442.000-2445.000=-3.000
mean28.710-28.657=0.053
σ0.044-0.027=0.017
min28.647-28.619=0.028
max28.749-28.682=0.066