Compare commits

Home / Compare dd431648 .. 2c129307

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.973=-0.175
σ0.108-0.108=-0.001
min35.751-35.925=-0.174
max36.104-36.280=-0.176
mean412.000
σ0.000
min412.000
max412.000
mean0.077-0.074=0.003
σ0.003-0.005=-0.002
min0.075-0.070=0.005
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.208=-0.143
σ0.004-0.004=0.000
min26.058-26.202=-0.144
max26.069-26.215=-0.145
mean412.000
σ0.000
min412.000
max412.000
mean0.062-0.060=0.002
σ0.002-0.004=-0.001
min0.060-0.056=0.004
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1758.365=-2.442
σ0.366-0.370=-0.004
min1755.345-1757.791=-2.445
max1756.513-1758.960=-2.447
mean1661.650-1652.950=8.700
σ628.595-649.610=-21.014
min669.000
max2661.000-2753.000=-92.000
mean2.815-2.366=0.449
σ0.157-0.106=0.051
min2.309-2.174=0.134
max3.011-2.646=0.365

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-279.509=-2.313
σ0.006-0.006=-0.001
min277.187-279.501=-2.314
max277.203-279.515=-2.312
mean2661.000-2753.000=-92.000
σ0.000
min2661.000-2753.000=-92.000
max2661.000-2753.000=-92.000
mean0.397-0.408=-0.011
σ0.009-0.007=0.003
min0.389-0.404=-0.015
max0.410-0.420=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2174.402-2178.438=-4.036
σ0.068-0.014=0.053
min2174.282-2178.426=-4.144
max2174.446-2178.462=-4.015
mean2661.000-2753.000=-92.000
σ0.000
min2661.000-2753.000=-92.000
max2661.000-2753.000=-92.000
mean3.072-3.347=-0.274
σ0.258-0.123=0.135
min2.779-3.225=-0.446
max3.483-3.532=-0.049
iters=5
new-facts=6402
prior-facts=1
mean5052.379-5056.368=-3.989
σ0.798-0.980=-0.182
min5051.582-5055.761=-4.179
max5053.709-5058.104=-4.395
mean2661.000-2753.000=-92.000
σ0.000
min2661.000-2753.000=-92.000
max2661.000-2753.000=-92.000
mean8.582-9.120=-0.538
σ0.459-0.536=-0.077
min8.146-8.210=-0.064
max9.298-9.581=-0.283
iters=5
new-facts=6402
prior-facts=6402
mean5188.426-5193.760=-5.334
σ0.090-0.090=-0.001
min5188.359-5193.686=-5.327
max5188.526-5193.860=-5.333
mean3221.400-3241.400=-20.000
σ356.709-340.469=16.240
min2719.000-2753.000=-34.000
max3660.000-3683.000=-23.000
mean8.839-9.028=-0.189
σ0.150-0.390=-0.239
min8.658-8.747=-0.088
max8.954-9.700=-0.747

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.188-0.978=0.210
σ0.317-0.063=0.255
min0.948-0.941=0.007
max1.709-1.088=0.621

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-465.492=-0.637
σ572.659-572.681=-0.023
min178.523-179.139=-0.616
max1323.844-1324.514=-0.670
mean79.500
σ7.000
min76.000
max90.000
mean2661.000-2753.000=-92.000
σ0.000
min2661.000-2753.000=-92.000
max2661.000-2753.000=-92.000
mean0.558-0.563=-0.005
σ0.535-0.563=-0.027
min0.279-0.278=0.001
max1.360-1.407=-0.047
policies=20
mean1785.481-1791.697=-6.216
σ0.343-0.342=0.001
min1785.258-1791.478=-6.220
max1785.990-1792.206=-6.216
mean760.000
σ0.000
min760.000
max760.000
mean2661.000-2753.000=-92.000
σ0.000
min2661.000-2753.000=-92.000
max2661.000-2753.000=-92.000
mean2.770-2.808=-0.038
σ0.019-0.007=0.012
min2.743-2.804=-0.062
max2.785-2.819=-0.034
policies=200
mean17861.531-17923.419=-61.888
σ0.459-0.418=0.040
min17861.283-17923.106=-61.823
max17862.219-17924.033=-61.815
mean7600.000
σ0.000
min7600.000
max7600.000
mean2661.000-2753.000=-92.000
σ0.000
min2661.000-2753.000=-92.000
max2661.000-2753.000=-92.000
mean28.186-28.212=-0.026
σ0.170-0.121=0.049
min28.010-28.108=-0.098
max28.391-28.385=0.006