Compare commits

Home / Compare e69533ae .. 3d941d4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.560-70.558=0.002
σ0.048-0.048=-0.001
min70.528-70.530=-0.002
max70.694-70.693=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.160=0.000
σ0.003-0.003=0.000
min0.157-0.155=0.003
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.002-0.003=-0.001
min21.285-21.283=0.002
max21.292-21.291=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.065=0.000
σ0.003-0.002=0.000
min0.061-0.064=-0.003
max0.072-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.072-1753.067=0.004
σ0.361-0.362=-0.001
min1752.498-1752.501=-0.003
max1753.644-1753.652=-0.007
mean1654.000-1657.600=-3.600
σ633.910-631.866=2.044
min628.000-617.000=11.000
max2850.000-2767.000=83.000
mean2.756-2.747=0.009
σ0.219-0.181=0.038
min2.250-2.150=0.101
max3.010-2.915=0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.278-271.290=-0.012
σ0.011-0.004=0.006
min271.266-271.286=-0.021
max271.291-271.297=-0.006
mean2850.000-2767.000=83.000
σ0.000
min2850.000-2767.000=83.000
max2850.000-2767.000=83.000
mean0.387-0.384=0.003
σ0.012-0.006=0.006
min0.372-0.379=-0.007
max0.401-0.392=0.009
iters=5
new-facts=1
prior-facts=6402
mean1931.718-1931.710=0.008
σ0.007-0.010=-0.003
min1931.709-1931.694=0.016
max1931.725-1931.720=0.006
mean2850.000-2767.000=83.000
σ0.000
min2850.000-2767.000=83.000
max2850.000-2767.000=83.000
mean3.030-3.047=-0.017
σ0.220-0.122=0.098
min2.806-2.906=-0.100
max3.372-3.214=0.158
iters=5
new-facts=6402
prior-facts=1
mean4752.478-4752.471=0.008
σ0.909-0.858=0.051
min4751.908-4751.997=-0.089
max4754.075-4753.999=0.075
mean2850.000-2767.000=83.000
σ0.000
min2850.000-2767.000=83.000
max2850.000-2767.000=83.000
mean8.506-8.364=0.142
σ0.632-0.394=0.238
min7.812-7.795=0.017
max9.185-8.835=0.350
iters=5
new-facts=6402
prior-facts=6402
mean4942.850-4942.772=0.078
σ0.147-0.188=-0.041
min4942.590-4942.555=0.034
max4942.935-4942.914=0.021
mean3063.800-3037.600=26.200
σ265.251-210.007=55.245
min2850.000-2767.000=83.000
max3458.000-3321.000=137.000
mean8.645-8.535=0.110
σ0.151-0.165=-0.014
min8.484-8.372=0.112
max8.804-8.715=0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-1.015=0.043
σ0.137-0.132=0.005
min0.941-0.928=0.013
max1.276-1.234=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.028-467.029=-0.001
σ575.921-575.927=-0.006
min179.064-179.057=0.007
max1330.910-1330.920=-0.010
mean84.250
σ8.500
min80.000
max97.000
mean2850.000-2767.000=83.000
σ0.000
min2850.000-2767.000=83.000
max2850.000-2767.000=83.000
mean0.444-0.470=-0.026
σ0.304-0.378=-0.074
min0.287-0.278=0.010
max0.899-1.038=-0.138
policies=20
mean1790.882-1790.875=0.007
σ0.362-0.347=0.016
min1790.622-1790.639=-0.017
max1791.414-1791.391=0.023
mean800.000
σ0.000
min800.000
max800.000
mean2850.000-2767.000=83.000
σ0.000
min2850.000-2767.000=83.000
max2850.000-2767.000=83.000
mean2.853-2.773=0.080
σ0.012-0.013=-0.001
min2.837-2.760=0.077
max2.864-2.790=0.075
policies=200
mean17915.339-17915.278=0.061
σ0.451-0.463=-0.012
min17915.054-17914.879=0.175
max17916.009-17915.946=0.064
mean8000.000
σ0.000
min8000.000
max8000.000
mean2850.000-2767.000=83.000
σ0.000
min2850.000-2767.000=83.000
max2850.000-2767.000=83.000
mean28.475-28.083=0.393
σ0.510-0.197=0.313
min27.953-27.880=0.073
max28.987-28.323=0.664