Compare commits

Home / Compare 1d648f4d .. 720c6728

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.050=-0.003
min33.951-33.952=-0.001
max34.111-34.118=-0.007
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.082-0.082=0.000
σ0.005-0.004=0.001
min0.077-0.076=0.001
max0.091-0.088=0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.003=-0.000
min23.313-23.311=0.002
max23.323-23.322=0.001
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.065-0.062=0.003
σ0.003-0.004=-0.001
min0.064-0.060=0.004
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.430=0.064
σ0.366-0.365=0.001
min1756.918-1756.855=0.063
max1758.082-1758.021=0.062
mean1668.000-1646.100=21.900
σ627.166-625.327=1.838
min673.000-635.000=38.000
max2617.000-2834.000=-217.000
mean2.377-2.378=-0.001
σ0.118-0.092=0.026
min2.261-2.261=0.000
max2.743-2.665=0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.628-326.577=0.051
σ0.058-0.048=0.010
min326.525-326.492=0.033
max326.660-326.608=0.052
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean0.426-0.430=-0.003
σ0.004-0.005=-0.001
min0.422-0.426=-0.004
max0.433-0.437=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1848.406=140.393
σ0.011-313.818=-313.807
min1988.787-1287.030=701.756
max1988.813-1988.769=0.044
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean2.674-2.480=0.194
σ0.053-0.458=-0.405
min2.624-1.708=0.916
max2.745-2.866=-0.121
iters=5
new-facts=6402
prior-facts=1
mean4813.602-4813.617=-0.016
σ7.773-7.750=0.024
min4809.734-4810.071=-0.337
max4827.500-4827.479=0.021
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean8.252-8.646=-0.394
σ0.621-0.638=-0.017
min7.833-7.682=0.151
max9.314-9.347=-0.033
iters=5
new-facts=6402
prior-facts=6402
mean5001.199-5001.141=0.058
σ0.022-0.028=-0.006
min5001.173-5001.103=0.070
max5001.224-5001.171=0.053
mean2970.600-2996.200=-25.600
σ388.440-167.727=220.713
min2617.000-2834.000=-217.000
max3516.000-3233.000=283.000
mean9.550-9.731=-0.181
σ0.281-0.185=0.096
min9.279-9.560=-0.281
max9.956-10.028=-0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.267-0.948=0.320
σ0.415-0.058=0.357
min0.923-0.910=0.012
max1.810-1.049=0.761

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.635-464.573=0.062
σ574.791-574.772=0.020
min177.231-177.177=0.054
max1326.822-1326.730=0.091
mean88.250
σ8.500
min84.000
max101.000
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean0.545-0.437=0.107
σ0.541-0.312=0.229
min0.270-0.271=-0.001
max1.357-0.906=0.451
policies=20
mean1772.671-1772.078=0.593
σ0.342-0.363=-0.022
min1772.442-1771.829=0.613
max1773.178-1772.614=0.564
mean840.000
σ0.000
min840.000
max840.000
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean2.712-2.811=-0.099
σ0.012-0.009=0.004
min2.695-2.800=-0.105
max2.722-2.821=-0.099
policies=200
mean17733.950-17727.588=6.362
σ0.583-0.422=0.161
min17733.534-17727.170=6.364
max17734.812-17728.165=6.647
mean8400.000
σ0.000
min8400.000
max8400.000
mean2617.000-2834.000=-217.000
σ0.000
min2617.000-2834.000=-217.000
max2617.000-2834.000=-217.000
mean27.436-27.996=-0.560
σ0.159-0.404=-0.245
min27.305-27.568=-0.263
max27.648-28.447=-0.799