Compare commits

Home / Compare d59ec315 .. 57a9a264

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.783=-0.000
σ0.045-0.047=-0.002
min70.749-70.749=-0.001
max70.906-70.912=-0.006
mean414.100-414.600=-0.500
σ0.316-0.516=-0.200
min414.000
max415.000
mean0.160-0.161=-0.000
σ0.006-0.004=0.001
min0.151-0.154=-0.002
max0.168-0.169=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.003-0.003=0.001
min21.488-21.490=-0.002
max21.497-21.498=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.067-0.063=0.004
σ0.003-0.003=-0.000
min0.065-0.060=0.005
max0.074-0.068=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.093=-0.000
σ0.363-0.360=0.003
min1753.527-1753.529=-0.002
max1754.677-1754.674=0.003
mean1670.450-1654.100=16.350
σ633.071-622.764=10.307
min690.000-628.000=62.000
max2778.000-2771.000=7.000
mean2.792-2.765=0.027
σ0.154-0.177=-0.023
min2.260-2.295=-0.034
max2.972-3.051=-0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.601-271.599=0.002
σ0.005-0.005=-0.000
min271.595-271.591=0.004
max271.606-271.604=0.001
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean0.391-0.385=0.006
σ0.012-0.004=0.008
min0.383-0.381=0.001
max0.410-0.390=0.020
iters=5
new-facts=1
prior-facts=6402
mean1932.001-1932.003=-0.002
σ0.010-0.010=-0.000
min1931.988-1931.989=-0.001
max1932.011-1932.016=-0.005
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean2.546-2.516=0.030
σ0.113-0.084=0.029
min2.468-2.405=0.063
max2.736-2.603=0.133
iters=5
new-facts=6402
prior-facts=1
mean4752.662-4752.733=-0.071
σ0.949-0.916=0.033
min4751.762-4752.222=-0.459
max4754.279-4754.365=-0.086
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean8.315-8.852=-0.537
σ0.384-0.268=0.116
min7.649-8.551=-0.902
max8.641-9.230=-0.589
iters=5
new-facts=6402
prior-facts=6402
mean4943.134-4943.136=-0.002
σ0.166-0.151=0.014
min4942.839-4942.870=-0.030
max4943.229-4943.233=-0.004
mean3048.400-3018.600=29.800
σ251.368-224.724=26.644
min2778.000-2771.000=7.000
max3397.000-3311.000=86.000
mean8.633-8.541=0.092
σ0.158-0.088=0.070
min8.414-8.439=-0.025
max8.831-8.646=0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.011-1.003=0.008
σ0.119-0.142=-0.022
min0.927-0.939=-0.012
max1.196-1.256=-0.060

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.641-468.637=0.004
σ574.924-574.924=0.000
min181.168-181.164=0.004
max1331.026-1331.022=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean0.449-0.446=0.004
σ0.305-0.294=0.011
min0.295-0.297=-0.002
max0.906-0.886=0.020
policies=20
mean1812.003-1811.970=0.033
σ0.376-0.389=-0.013
min1811.723-1811.696=0.026
max1812.546-1812.539=0.007
mean840.000
σ0.000
min840.000
max840.000
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean2.954-2.911=0.043
σ0.035-0.093=-0.058
min2.928-2.835=0.093
max3.005-3.034=-0.030
policies=200
mean18126.780-18126.639=0.141
σ0.522-0.402=0.119
min18126.492-18126.257=0.235
max18127.560-18127.197=0.364
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000-2771.000=7.000
σ0.000
min2778.000-2771.000=7.000
max2778.000-2771.000=7.000
mean28.727-28.684=0.043
σ0.068-0.121=-0.052
min28.645-28.582=0.063
max28.800-28.856=-0.057