Compare commits

Home / Compare 582e10a9 .. 6cdb6bcb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.397=-0.005
σ0.045-0.044=0.001
min70.370-70.373=-0.003
max70.519-70.518=0.000
mean410.200-416.000=-5.800
σ0.422-0.000=0.422
min410.000-416.000=-6.000
max411.000-416.000=-5.000
mean0.160-0.159=0.001
σ0.003-0.003=-0.000
min0.158-0.155=0.002
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.147-21.144=0.003
σ0.012-0.003=0.010
min21.140-21.140=0.000
max21.181-21.147=0.034
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.062-0.064=-0.001
σ0.004-0.002=0.002
min0.058-0.062=-0.004
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.697-1752.696=0.000
σ0.358-0.360=-0.001
min1752.129-1752.128=0.001
max1753.264-1753.279=-0.015
mean1657.600-1662.850=-5.250
σ628.909-634.302=-5.392
min615.000-619.000=-4.000
max2764.000-2772.000=-8.000
mean2.736-2.789=-0.054
σ0.242-0.203=0.039
min2.143-2.183=-0.040
max3.077-3.017=0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.608-270.608=-0.001
σ0.004-0.004=0.000
min270.601-270.604=-0.003
max270.611-270.613=-0.001
mean2764.000-2772.000=-8.000
σ0.000
min2764.000-2772.000=-8.000
max2764.000-2772.000=-8.000
mean0.378-0.378=0.000
σ0.001-0.001=0.000
min0.377-0.377=-0.000
max0.379-0.378=0.001
iters=5
new-facts=1
prior-facts=6402
mean1931.044-1931.040=0.004
σ0.011-0.008=0.003
min1931.032-1931.034=-0.001
max1931.061-1931.053=0.008
mean2764.000-2772.000=-8.000
σ0.000
min2764.000-2772.000=-8.000
max2764.000-2772.000=-8.000
mean3.014-2.988=0.026
σ0.148-0.157=-0.009
min2.827-2.739=0.088
max3.192-3.132=0.060
iters=5
new-facts=6402
prior-facts=1
mean4751.604-4751.795=-0.191
σ1.009-0.890=0.119
min4750.807-4751.250=-0.442
max4753.372-4753.376=-0.004
mean2764.000-2772.000=-8.000
σ0.000
min2764.000-2772.000=-8.000
max2764.000-2772.000=-8.000
mean8.778-8.527=0.251
σ0.552-0.397=0.154
min7.823-7.975=-0.152
max9.172-9.052=0.120
iters=5
new-facts=6402
prior-facts=6402
mean4942.161-4942.095=0.066
σ0.167-0.194=-0.027
min4941.863-4941.869=-0.006
max4942.255-4942.254=0.001
mean3050.800-3045.600=5.200
σ274.494-234.934=39.561
min2764.000-2772.000=-8.000
max3432.000-3373.000=59.000
mean8.604-8.557=0.047
σ0.161-0.164=-0.002
min8.366-8.387=-0.022
max8.812-8.806=0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.103=-0.073
σ0.216-0.266=-0.050
min0.929-0.949=-0.020
max1.416-1.566=-0.150

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.205-467.209=-0.005
σ575.929-575.933=-0.004
min179.231-179.231=0.000
max1331.099-1331.109=-0.010
mean86.250
σ8.500
min82.000
max99.000
mean2764.000-2772.000=-8.000
σ0.000
min2764.000-2772.000=-8.000
max2764.000-2772.000=-8.000
mean0.478-0.448=0.030
σ0.391-0.308=0.083
min0.281-0.292=-0.010
max1.065-0.911=0.154
policies=20
mean1792.621-1792.629=-0.008
σ0.367-0.341=0.026
min1792.417-1792.371=0.046
max1793.170-1793.121=0.048
mean820.000
σ0.000
min820.000
max820.000
mean2764.000-2772.000=-8.000
σ0.000
min2764.000-2772.000=-8.000
max2764.000-2772.000=-8.000
mean2.797-2.841=-0.044
σ0.027-0.100=-0.073
min2.774-2.785=-0.012
max2.836-2.991=-0.155
policies=200
mean17932.930-17933.081=-0.151
σ0.472-0.525=-0.054
min17932.567-17932.771=-0.205
max17933.618-17933.867=-0.250
mean8200.000
σ0.000
min8200.000
max8200.000
mean2764.000-2772.000=-8.000
σ0.000
min2764.000-2772.000=-8.000
max2764.000-2772.000=-8.000
mean28.100-28.220=-0.119
σ0.200-0.349=-0.149
min27.935-28.033=-0.097
max28.374-28.743=-0.369