Compare commits

Home / Compare 4318fc5d .. 36c1177c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.728=0.002
σ0.047-0.045=0.002
min70.704-70.706=-0.002
max70.861-70.854=0.007
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.158-0.157=0.001
σ0.006-0.005=0.001
min0.150-0.149=0.001
max0.168-0.162=0.006
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.002
σ0.003-0.003=-0.000
min21.440-21.442=-0.002
max21.449-21.452=-0.003
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.065-0.066=-0.000
σ0.003-0.002=0.001
min0.064-0.064=-0.001
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.524=0.003
σ0.360-0.360=0.001
min1753.965-1753.964=0.001
max1755.105-1755.105=0.000
mean1663.650-1662.550=1.100
σ643.462-624.233=19.229
min610.000-637.000=-27.000
max2732.000-2503.000=229.000
mean2.899-2.836=0.063
σ0.153-0.175=-0.023
min2.485-2.461=0.024
max3.151-3.272=-0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.612=-0.005
σ0.009-0.005=0.004
min273.601-273.606=-0.005
max273.622-273.620=0.002
mean2732.000-2503.000=229.000
σ0.000
min2732.000-2503.000=229.000
max2732.000-2503.000=229.000
mean0.385-0.387=-0.002
σ0.006-0.007=-0.001
min0.380-0.381=-0.001
max0.396-0.398=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.993-1934.002=-0.010
σ0.006-0.007=-0.001
min1933.987-1933.994=-0.007
max1933.999-1934.013=-0.013
mean2732.000-2503.000=229.000
σ0.000
min2732.000-2503.000=229.000
max2732.000-2503.000=229.000
mean2.887-2.976=-0.089
σ0.254-0.214=0.041
min2.467-2.736=-0.269
max3.109-3.255=-0.147
iters=5
new-facts=6402
prior-facts=1
mean4754.756-4754.703=0.053
σ0.914-0.907=0.007
min4754.248-4754.284=-0.036
max4756.373-4756.325=0.048
mean2732.000-2503.000=229.000
σ0.000
min2732.000-2503.000=229.000
max2732.000-2503.000=229.000
mean8.982-8.881=0.101
σ0.440-0.031=0.409
min8.273-8.850=-0.577
max9.481-8.922=0.559
iters=5
new-facts=6402
prior-facts=6402
mean4945.085-4945.222=-0.138
σ0.203-0.014=0.189
min4944.861-4945.202=-0.341
max4945.239-4945.240=-0.000
mean2972.200-2988.800=-16.600
σ219.062-286.732=-67.670
min2732.000-2607.000=125.000
max3285.000-3346.000=-61.000
mean8.514-8.491=0.023
σ0.048-0.043=0.005
min8.454-8.443=0.010
max8.555-8.543=0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.707=-0.706
σ0.141-0.290=-0.149
min0.938-1.274=-0.336
max1.255-1.936=-0.681

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.843-472.832=0.011
σ574.928-574.930=-0.002
min185.374-185.365=0.009
max1335.236-1335.227=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2732.000-2503.000=229.000
σ0.000
min2732.000-2503.000=229.000
max2732.000-2503.000=229.000
mean0.570-0.558=0.012
σ0.555-0.537=0.018
min0.291-0.288=0.003
max1.403-1.363=0.040
policies=20
mean1853.993-1853.982=0.012
σ0.377-0.380=-0.003
min1853.738-1853.712=0.026
max1854.550-1854.539=0.011
mean840.000
σ0.000
min840.000
max840.000
mean2732.000-2503.000=229.000
σ0.000
min2732.000-2503.000=229.000
max2732.000-2503.000=229.000
mean2.880-2.891=-0.011
σ0.010-0.054=-0.044
min2.871-2.840=0.031
max2.895-2.959=-0.065
policies=200
mean18546.607-18546.603=0.005
σ0.510-0.469=0.041
min18546.297-18546.296=0.000
max18547.363-18547.294=0.069
mean8400.000
σ0.000
min8400.000
max8400.000
mean2732.000-2503.000=229.000
σ0.000
min2732.000-2503.000=229.000
max2732.000-2503.000=229.000
mean28.964-29.004=-0.039
σ0.113-0.098=0.015
min28.797-28.929=-0.132
max29.046-29.145=-0.099