Compare commits

Home / Compare 6694f179 .. 1f369cbe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.733
σ0.616
min35.920
max37.217
mean3779.000
σ0.000
min3779.000
max3779.000
mean0.076
σ0.003
min0.071
max0.080
cache=y
dps=1
iters=10
policies=100
mean26.714
σ0.648
min26.208
max27.470
mean3779.000
σ0.000
min3779.000
max3779.000
mean0.059
σ0.001
min0.057
max0.060

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.359-1744.487=11.873
σ0.373-0.376=-0.003
min1755.786-1743.896=11.890
max1756.961-1745.093=11.869
mean1636.800-1643.450=-6.650
σ620.593-633.860=-13.267
min631.000-618.000=13.000
max2832.000-2755.000=77.000
mean2.264-2.112=0.152
σ0.122-0.131=-0.008
min2.129-1.998=0.131
max2.674-2.571=0.103

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.673
σ0.011
min278.663
max278.691
mean2832.000
σ0.000
min2832.000
max2832.000
mean0.420
σ0.001
min0.418
max0.421
iters=5
new-facts=1
prior-facts=6402
mean2268.832
σ0.023
min2268.802
max2268.853
mean2832.000
σ0.000
min2832.000
max2832.000
mean3.204
σ0.171
min2.920
max3.347
iters=5
new-facts=6402
prior-facts=1
mean4952.070
σ0.873
min4951.236
max4953.555
mean2832.000
σ0.000
min2832.000
max2832.000
mean7.793
σ0.193
min7.589
max8.069
iters=5
new-facts=6402
prior-facts=6402
mean5166.685
σ0.305
min5166.211
max5166.892
mean3338.200
σ439.730
min2832.000
max3779.000
mean9.223
σ0.144
min9.078
max9.464

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.611
σ0.194
min1.303
max1.776

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.255-505.034=-44.780
σ572.608-662.962=-90.354
min173.949-173.547=0.402
max1319.167-1499.477=-180.311
mean79.500-81.500=-2.000
σ7.000
min76.000-78.000=-2.000
max90.000-92.000=-2.000
mean437.000-434.000=3.000
σ0.000
min437.000-434.000=3.000
max437.000-434.000=3.000
mean0.538-0.568=-0.030
σ0.519-0.571=-0.052
min0.273-0.279=-0.006
max1.317-1.425=-0.108
policies=20
mean1740.012-1737.069=2.944
σ0.338-0.902=-0.565
min1739.774-1736.173=3.600
max1740.509-1738.270=2.239
mean760.000-780.000=-20.000
σ0.000
min760.000-780.000=-20.000
max760.000-780.000=-20.000
mean448.750-446.750=2.000
σ10.874-11.057=-0.182
min437.000-434.000=3.000
max458.000-461.000=-3.000
mean2.671-2.719=-0.047
σ0.013-0.023=-0.011
min2.659-2.688=-0.029
max2.686-2.741=-0.055
policies=200
mean17409.343-17402.370=6.973
σ0.094-0.074=0.020
min17409.252-17402.260=6.992
max17409.473-17402.416=7.058
mean7600.000-7800.000=-200.000
σ0.000
min7600.000-7800.000=-200.000
max7600.000-7800.000=-200.000
mean492.750-497.000=-4.250
σ2.500-2.449=0.051
min490.000-494.000=-4.000
max496.000-500.000=-4.000
mean26.990-27.264=-0.274
σ0.041-0.017=0.024
min26.933-27.253=-0.320
max27.027-27.290=-0.263