Compare commits

Home / Compare e62e7284 .. 7e85ffba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.560=0.003
σ0.049-0.048=0.001
min70.532-70.530=0.002
max70.699-70.692=0.007
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.156-0.162=-0.005
σ0.005-0.003=0.002
min0.150-0.158=-0.008
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.289-21.287=0.002
σ0.011-0.003=0.008
min21.282-21.283=-0.002
max21.320-21.292=0.028
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.000
min0.058-0.060=-0.002
max0.068-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.070-1753.069=0.001
σ0.361-0.361=-0.000
min1752.500-1752.498=0.002
max1753.656-1753.656=0.000
mean1657.500-1657.750=-0.250
σ632.509-631.708=0.801
min618.000
max2765.000-2767.000=-2.000
mean2.778-2.746=0.032
σ0.112-0.183=-0.071
min2.508-2.293=0.215
max2.973-2.954=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.382-271.288=0.093
σ0.007-0.007=-0.001
min271.372-271.276=0.097
max271.391-271.295=0.096
mean2765.000-2767.000=-2.000
σ0.000
min2765.000-2767.000=-2.000
max2765.000-2767.000=-2.000
mean0.379-0.378=0.002
σ0.006-0.006=-0.000
min0.374-0.369=0.005
max0.389-0.385=0.004
iters=5
new-facts=1
prior-facts=6402
mean1931.816-1931.710=0.106
σ0.002-0.016=-0.014
min1931.813-1931.690=0.123
max1931.818-1931.728=0.090
mean2765.000-2767.000=-2.000
σ0.000
min2765.000-2767.000=-2.000
max2765.000-2767.000=-2.000
mean2.912-2.875=0.037
σ0.168-0.121=0.047
min2.658-2.688=-0.030
max3.094-2.982=0.112
iters=5
new-facts=6402
prior-facts=1
mean4752.540-4752.343=0.197
σ0.853-0.937=-0.084
min4752.047-4751.516=0.531
max4754.055-4753.955=0.099
mean2765.000-2767.000=-2.000
σ0.000
min2765.000-2767.000=-2.000
max2765.000-2767.000=-2.000
mean8.512-8.332=0.180
σ0.496-0.476=0.020
min7.745-7.734=0.011
max9.005-8.978=0.027
iters=5
new-facts=6402
prior-facts=6402
mean4943.005-4942.842=0.163
σ0.015-0.162=-0.147
min4942.982-4942.554=0.429
max4943.023-4942.931=0.092
mean3045.800-3022.800=23.000
σ252.112-224.380=27.733
min2765.000-2767.000=-2.000
max3395.000-3307.000=88.000
mean8.538-8.552=-0.014
σ0.170-0.145=0.025
min8.327-8.385=-0.058
max8.788-8.728=0.060

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.017=0.018
σ0.143-0.142=0.000
min0.937-0.921=0.016
max1.263-1.252=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.414-467.029=0.385
σ575.929-575.925=0.003
min179.441-179.057=0.384
max1331.307-1330.917=0.390
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2765.000-2767.000=-2.000
σ0.000
min2765.000-2767.000=-2.000
max2765.000-2767.000=-2.000
mean0.467-0.463=0.003
σ0.372-0.367=0.005
min0.278-0.280=-0.001
max1.024-1.014=0.010
policies=20
mean1794.685-1790.880=3.805
σ0.358-0.352=0.005
min1794.485-1790.636=3.849
max1795.221-1791.403=3.817
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2765.000-2767.000=-2.000
σ0.000
min2765.000-2767.000=-2.000
max2765.000-2767.000=-2.000
mean2.798-2.766=0.032
σ0.031-0.019=0.012
min2.771-2.743=0.028
max2.841-2.790=0.051
policies=200
mean17953.554-17915.298=38.255
σ0.433-0.523=-0.091
min17953.306-17914.881=38.426
max17954.202-17916.064=38.138
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2765.000-2767.000=-2.000
σ0.000
min2765.000-2767.000=-2.000
max2765.000-2767.000=-2.000
mean28.239-28.039=0.200
σ0.316-0.104=0.212
min27.962-27.923=0.039
max28.693-28.173=0.519