Compare commits

Home / Compare 20d384bc .. e91eba7d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.561=0.134
σ0.046-0.046=0.000
min70.672-70.539=0.133
max70.824-70.690=0.134
mean411.000-414.400=-3.400
σ0.000-0.516=-0.516
min411.000-414.000=-3.000
max411.000-415.000=-4.000
mean0.160-0.156=0.004
σ0.003-0.005=-0.002
min0.157-0.149=0.007
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.424-21.292=0.132
σ0.012-0.011=0.001
min21.413-21.284=0.130
max21.458-21.323=0.135
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1753.568=0.890
σ0.358-0.361=-0.003
min1753.890-1752.998=0.892
max1755.027-1754.141=0.886
mean1671.800-1642.800=29.000
σ652.553-630.591=21.962
min623.000-628.000=-5.000
max2862.000-2851.000=11.000
mean2.804-2.796=0.007
σ0.162-0.154=0.008
min2.324-2.323=0.001
max2.967-3.016=-0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.507-272.015=1.492
σ0.005-0.004=0.001
min273.502-272.011=1.492
max273.514-272.020=1.494
mean2862.000-2851.000=11.000
σ0.000
min2862.000-2851.000=11.000
max2862.000-2851.000=11.000
mean0.377-0.382=-0.005
σ0.005-0.012=-0.006
min0.372-0.370=0.002
max0.386-0.402=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1932.442=1.455
σ0.015-0.010=0.005
min1933.888-1932.428=1.461
max1933.924-1932.457=1.467
mean2862.000-2851.000=11.000
σ0.000
min2862.000-2851.000=11.000
max2862.000-2851.000=11.000
mean2.856-3.146=-0.291
σ0.291-0.267=0.024
min2.428-2.985=-0.556
max3.168-3.613=-0.446
iters=5
new-facts=6402
prior-facts=1
mean4754.732-4753.171=1.561
σ0.819-0.811=0.008
min4754.259-4752.698=1.561
max4756.193-4754.609=1.584
mean2862.000-2851.000=11.000
σ0.000
min2862.000-2851.000=11.000
max2862.000-2851.000=11.000
mean7.917-8.449=-0.532
σ0.467-0.541=-0.074
min7.484-7.631=-0.147
max8.711-8.943=-0.232
iters=5
new-facts=6402
prior-facts=6402
mean4945.111-4943.635=1.476
σ0.010-0.026=-0.016
min4945.097-4943.603=1.495
max4945.123-4943.665=1.458
mean3064.200-3080.800=-16.600
σ286.046-232.578=53.467
min2862.000-2851.000=11.000
max3518.000-3316.000=202.000
mean8.423-8.752=-0.329
σ0.128-0.361=-0.233
min8.314-8.364=-0.050
max8.566-9.309=-0.743

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.082=-0.036
σ0.129-0.265=-0.135
min0.932-0.933=-0.001
max1.247-1.545=-0.298

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.077-473.080=-0.002
σ575.911-575.914=-0.004
min185.115-185.117=-0.002
max1336.943-1336.951=-0.008
mean88.250
σ8.500
min84.000
max101.000
mean2862.000-2851.000=11.000
σ0.000
min2862.000-2851.000=11.000
max2862.000-2851.000=11.000
mean0.450-0.448=0.002
σ0.301-0.302=-0.001
min0.298-0.296=0.001
max0.902-0.900=0.001
policies=20
mean1851.463-1851.432=0.031
σ0.387-0.377=0.010
min1851.187-1851.155=0.032
max1852.028-1851.984=0.045
mean840.000
σ0.000
min840.000
max840.000
mean2862.000-2851.000=11.000
σ0.000
min2862.000-2851.000=11.000
max2862.000-2851.000=11.000
mean2.942-2.924=0.018
σ0.012-0.019=-0.007
min2.925-2.901=0.024
max2.952-2.947=0.005
policies=200
mean18519.886-18521.073=-1.188
σ0.742-0.573=0.170
min18519.246-18520.735=-1.489
max18520.772-18521.927=-1.155
mean8400.000
σ0.000
min8400.000
max8400.000
mean2862.000-2851.000=11.000
σ0.000
min2862.000-2851.000=11.000
max2862.000-2851.000=11.000
mean29.019-29.007=0.013
σ0.537-0.431=0.106
min28.715-28.674=0.041
max29.822-29.621=0.201