Compare commits

Home / Compare ba21d6aa .. 362753ba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798
σ0.107
min35.751
max36.101
mean415.000
σ0.000
min415.000
max415.000
mean0.073
σ0.004
min0.069
max0.080
cache=y
dps=1
iters=10
policies=100
mean26.064
σ0.004
min26.058
max26.071
mean415.000
σ0.000
min415.000
max415.000
mean0.060
σ0.003
min0.057
max0.068

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1991.759=-235.836
σ0.366-0.374=-0.008
min1755.349-1991.173=-235.824
max1756.515-1992.392=-235.877
mean1663.750-1640.700=23.050
σ636.281-620.154=16.127
min672.000-628.000=44.000
max2711.000-2774.000=-63.000
mean2.822-2.199=0.623
σ0.111-0.180=-0.069
min2.495-2.077=0.417
max2.954-2.906=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.195
σ0.005
min277.189
max277.202
mean2711.000
σ0.000
min2711.000
max2711.000
mean0.397
σ0.007
min0.390
max0.406
iters=5
new-facts=1
prior-facts=6402
mean2174.432
σ0.022
min2174.401
max2174.454
mean2711.000
σ0.000
min2711.000
max2711.000
mean2.943
σ0.145
min2.744
max3.145
iters=5
new-facts=6402
prior-facts=1
mean5052.607
σ0.958
min5052.010
max5054.293
mean2711.000
σ0.000
min2711.000
max2711.000
mean9.306
σ0.459
min8.914
max10.061
iters=5
new-facts=6402
prior-facts=6402
mean5188.420
σ0.088
min5188.350
max5188.524
mean3237.800
σ372.068
min2720.000
max3692.000
mean8.828
σ0.300
min8.476
max9.253

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.252
σ0.307
min0.946
max1.677

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-558.586=-93.729
σ572.653-660.965=-88.312
min178.523-228.097=-49.574
max1323.836-1550.034=-226.198
mean79.500-89.500=-10.000
σ7.000
min76.000-86.000=-10.000
max90.000-100.000=-10.000
mean2711.000-434.000=2277.000
σ0.000
min2711.000-434.000=2277.000
max2711.000-434.000=2277.000
mean0.559-0.632=-0.073
σ0.559-0.552=0.008
min0.275-0.354=-0.079
max1.398-1.459=-0.062
policies=20
mean1785.488-2282.786=-497.297
σ0.352-0.893=-0.541
min1785.251-2281.698=-496.447
max1786.010-2283.668=-497.658
mean760.000-860.000=-100.000
σ0.000
min760.000-860.000=-100.000
max760.000-860.000=-100.000
mean2711.000-460.500=2250.500
σ0.000-21.237=-21.237
min2711.000-437.000=2274.000
max2711.000-485.000=2226.000
mean2.787-3.514=-0.727
σ0.026-0.018=0.008
min2.766-3.498=-0.733
max2.824-3.540=-0.716
policies=200
mean17861.465-22844.798=-4983.333
σ0.369-0.075=0.293
min17861.247-22844.727=-4983.480
max17862.015-22844.896=-4982.881
mean7600.000-8600.000=-1000.000
σ0.000
min7600.000-8600.000=-1000.000
max7600.000-8600.000=-1000.000
mean2711.000-494.750=2216.250
σ0.000-5.852=-5.852
min2711.000-488.000=2223.000
max2711.000-501.000=2210.000
mean28.076-35.437=-7.360
σ0.048-0.101=-0.053
min28.030-35.322=-7.292
max28.127-35.568=-7.441