Compare commits

Home / Compare aabb2927 .. 7f9b39ca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.002
σ0.050-0.048=0.001
min33.949-33.950=-0.001
max34.115-34.112=0.004
mean414.900-411.700=3.200
σ0.316-0.483=-0.167
min414.000-411.000=3.000
max415.000-412.000=3.000
mean0.083-0.084=-0.001
σ0.002-0.003=-0.000
min0.080-0.081=-0.001
max0.089-0.089=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.000
σ0.003-0.003=0.000
min23.313-23.312=0.001
max23.324-23.322=0.003
mean415.600-412.000=3.600
σ0.516-0.000=0.516
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.065-0.066=-0.000
σ0.003-0.003=-0.000
min0.063-0.063=0.001
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.364=-0.000
σ0.367-0.366=0.001
min1756.790-1756.789=0.001
max1757.955-1757.950=0.005
mean1652.600-1643.300=9.300
σ627.555-623.952=3.603
min633.000-632.000=1.000
max2836.000-2821.000=15.000
mean2.384-2.374=0.011
σ0.117-0.093=0.023
min2.257-2.272=-0.015
max2.808-2.643=0.165

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.517-326.517=-0.000
σ0.032-0.031=0.001
min326.461-326.464=-0.003
max326.541-326.543=-0.002
mean2836.000-2821.000=15.000
σ0.000
min2836.000-2821.000=15.000
max2836.000-2821.000=15.000
mean0.427-0.421=0.007
σ0.005-0.001=0.004
min0.421-0.420=0.002
max0.433-0.421=0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.667-1988.673=-0.005
σ0.018-0.014=0.004
min1988.644-1988.658=-0.014
max1988.683-1988.687=-0.005
mean2836.000-2821.000=15.000
σ0.000
min2836.000-2821.000=15.000
max2836.000-2821.000=15.000
mean2.753-2.672=0.081
σ0.228-0.084=0.144
min2.627-2.600=0.027
max3.157-2.811=0.346
iters=5
new-facts=6402
prior-facts=1
mean4813.510-4813.449=0.061
σ7.725-7.788=-0.063
min4809.980-4809.408=0.572
max4827.328-4827.367=-0.038
mean2836.000-2821.000=15.000
σ0.000
min2836.000-2821.000=15.000
max2836.000-2821.000=15.000
mean8.695-8.585=0.111
σ0.236-0.695=-0.459
min8.452-7.768=0.684
max9.066-9.375=-0.309
iters=5
new-facts=6402
prior-facts=6402
mean5000.948-5001.072=-0.125
σ0.213-0.023=0.190
min5000.713-5001.043=-0.330
max5001.131-5001.094=0.037
mean3037.800-3026.600=11.200
σ210.010-208.246=1.764
min2836.000-2821.000=15.000
max3337.000-3311.000=26.000
mean9.855-9.814=0.041
σ0.380-0.090=0.290
min9.183-9.726=-0.543
max10.086-9.916=0.171

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-0.935=0.040
σ0.067-0.055=0.013
min0.915-0.895=0.021
max1.053-1.027=0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.508-464.499=0.009
σ574.773-574.775=-0.003
min177.109-177.106=0.003
max1326.667-1326.662=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2836.000-2821.000=15.000
σ0.000
min2836.000-2821.000=15.000
max2836.000-2821.000=15.000
mean0.433-0.435=-0.001
σ0.308-0.304=0.004
min0.278-0.278=0.000
max0.896-0.890=0.006
policies=20
mean1771.421-1771.423=-0.001
σ0.375-0.356=0.020
min1771.160-1771.177=-0.018
max1771.976-1771.949=0.026
mean840.000
σ0.000
min840.000
max840.000
mean2836.000-2821.000=15.000
σ0.000
min2836.000-2821.000=15.000
max2836.000-2821.000=15.000
mean2.810-2.800=0.010
σ0.026-0.006=0.021
min2.773-2.795=-0.022
max2.830-2.806=0.024
policies=200
mean17720.874-17721.172=-0.297
σ0.153-0.510=-0.357
min17720.652-17720.795=-0.143
max17720.989-17721.917=-0.928
mean8400.000
σ0.000
min8400.000
max8400.000
mean2836.000-2821.000=15.000
σ0.000
min2836.000-2821.000=15.000
max2836.000-2821.000=15.000
mean27.923-27.893=0.030
σ0.400-0.369=0.031
min27.530-27.551=-0.020
max28.396-28.325=0.071