Compare commits

Home / Compare 7d6f2f3b .. acc2ad63

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.867-70.867=0.001
σ0.043-0.044=-0.001
min70.841-70.841=-0.001
max70.988-70.989=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.156-0.160=-0.004
σ0.004-0.003=0.001
min0.151-0.157=-0.006
max0.162-0.166=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.494-21.493=0.001
σ0.002-0.002=-0.000
min21.489-21.489=-0.000
max21.496-21.496=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.066=-0.002
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.095=-0.001
σ0.361-0.361=-0.000
min1753.533-1753.534=-0.000
max1754.677-1754.674=0.004
mean1654.150-1629.600=24.550
σ617.691-593.858=23.833
min655.000-640.000=15.000
max2489.000-2421.000=68.000
mean2.817-2.873=-0.056
σ0.143-0.116=0.028
min2.388-2.747=-0.359
max3.114-3.240=-0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.599=0.001
σ0.006-0.006=-0.000
min271.591-271.591=-0.001
max271.605-271.605=0.000
mean2489.000-2421.000=68.000
σ0.000
min2489.000-2421.000=68.000
max2489.000-2421.000=68.000
mean0.380-0.380=-0.001
σ0.004-0.003=0.000
min0.376-0.377=-0.001
max0.386-0.386=0.000
iters=5
new-facts=1
prior-facts=6402
mean1931.992-1931.999=-0.007
σ0.017-0.011=0.006
min1931.976-1931.985=-0.009
max1932.013-1932.011=0.002
mean2489.000-2421.000=68.000
σ0.000
min2489.000-2421.000=68.000
max2489.000-2421.000=68.000
mean2.504-2.504=0.000
σ0.104-0.122=-0.018
min2.422-2.381=0.041
max2.679-2.707=-0.028
iters=5
new-facts=6402
prior-facts=1
mean4752.730-4752.778=-0.048
σ0.902-0.848=0.053
min4752.257-4752.166=0.090
max4754.332-4754.266=0.066
mean2489.000-2421.000=68.000
σ0.000
min2489.000-2421.000=68.000
max2489.000-2421.000=68.000
mean8.551-8.434=0.116
σ0.574-0.655=-0.080
min7.571-7.642=-0.072
max8.987-9.351=-0.364
iters=5
new-facts=6402
prior-facts=6402
mean4943.147-4943.204=-0.057
σ0.140-0.022=0.119
min4942.898-4943.168=-0.270
max4943.225-4943.224=0.001
mean2935.400-3002.000=-66.600
σ310.927-280.008=30.919
min2489.000-2607.000=-118.000
max3318.000-3345.000=-27.000
mean8.419-8.585=-0.166
σ0.088-0.223=-0.135
min8.312-8.389=-0.077
max8.543-8.886=-0.343

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.765-1.793=-0.029
σ0.171-0.036=0.135
min1.499-1.750=-0.251
max1.966-1.844=0.122

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean479.750-479.655=0.095
σ597.173-596.975=0.198
min181.161-181.162=-0.001
max1375.509-1375.117=0.392
mean88.250
σ8.500
min84.000
max101.000
mean2489.000-2421.000=68.000
σ0.000
min2489.000-2421.000=68.000
max2489.000-2421.000=68.000
mean0.563-0.577=-0.014
σ0.554-0.579=-0.025
min0.285-0.286=-0.001
max1.395-1.446=-0.051
policies=20
mean1811.922-1811.948=-0.026
σ0.389-0.389=-0.000
min1811.667-1811.685=-0.018
max1812.499-1812.523=-0.024
mean840.000
σ0.000
min840.000
max840.000
mean2489.000-2421.000=68.000
σ0.000
min2489.000-2421.000=68.000
max2489.000-2421.000=68.000
mean2.803-2.819=-0.016
σ0.014-0.012=0.002
min2.787-2.801=-0.014
max2.821-2.829=-0.008
policies=200
mean18126.781-18126.829=-0.048
σ0.498-0.435=0.063
min18126.471-18126.499=-0.028
max18127.525-18127.469=0.055
mean8400.000
σ0.000
min8400.000
max8400.000
mean2489.000-2421.000=68.000
σ0.000
min2489.000-2421.000=68.000
max2489.000-2421.000=68.000
mean28.444-28.654=-0.210
σ0.080-0.158=-0.077
min28.351-28.529=-0.178
max28.511-28.875=-0.364