Compare commits

Home / Compare d7eb4c9c .. f9a7cb13

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.688-70.687=0.001
σ0.048-0.044=0.004
min70.662-70.664=-0.002
max70.823-70.811=0.012
mean415.000
σ0.000
min415.000
max415.000
mean0.157-0.164=-0.008
σ0.005-0.010=-0.005
min0.150-0.156=-0.007
max0.165-0.188=-0.023
cache=y
dps=1
iters=10
policies=100
mean21.420-21.421=-0.000
σ0.003-0.003=0.000
min21.417-21.416=0.001
max21.425-21.425=-0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.066=-0.001
σ0.002-0.002=-0.000
min0.064-0.064=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.460-1754.460=0.000
σ0.361-0.362=-0.001
min1753.883-1753.889=-0.006
max1755.035-1755.046=-0.012
mean1642.000-1673.800=-31.800
σ626.578-648.749=-22.172
min626.000-627.000=-1.000
max2853.000-2868.000=-15.000
mean2.771-2.754=0.017
σ0.201-0.192=0.009
min2.322-2.132=0.190
max3.175-2.949=0.226

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.504-273.508=-0.004
σ0.006-0.006=-0.001
min273.496-273.500=-0.004
max273.512-273.517=-0.005
mean2853.000-2868.000=-15.000
σ0.000
min2853.000-2868.000=-15.000
max2853.000-2868.000=-15.000
mean0.379-0.385=-0.006
σ0.005-0.003=0.002
min0.373-0.382=-0.009
max0.385-0.390=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.892-1933.886=0.006
σ0.004-0.033=-0.029
min1933.886-1933.829=0.056
max1933.895-1933.912=-0.018
mean2853.000-2868.000=-15.000
σ0.000
min2853.000-2868.000=-15.000
max2853.000-2868.000=-15.000
mean3.018-3.050=-0.032
σ0.066-0.113=-0.047
min2.931-2.930=0.001
max3.089-3.197=-0.108
iters=5
new-facts=6402
prior-facts=1
mean4754.579-4754.661=-0.082
σ0.907-0.845=0.062
min4753.763-4754.109=-0.346
max4756.131-4756.152=-0.021
mean2853.000-2868.000=-15.000
σ0.000
min2853.000-2868.000=-15.000
max2853.000-2868.000=-15.000
mean8.125-8.551=-0.426
σ0.498-0.638=-0.140
min7.737-7.692=0.045
max8.837-9.339=-0.502
iters=5
new-facts=6402
prior-facts=6402
mean4945.109-4945.040=0.069
σ0.018-0.163=-0.145
min4945.084-4944.750=0.334
max4945.129-4945.136=-0.007
mean3090.200-3067.600=22.600
σ312.309-210.377=101.932
min2853.000-2868.000=-15.000
max3574.000-3377.000=197.000
mean8.434-8.656=-0.222
σ0.112-0.256=-0.143
min8.345-8.440=-0.095
max8.626-9.062=-0.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.170=-0.139
σ0.140-0.308=-0.168
min0.935-0.945=-0.009
max1.257-1.569=-0.312

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.568-472.570=-0.002
σ574.928-574.942=-0.014
min185.102-185.090=0.011
max1334.960-1334.984=-0.024
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2868.000=-15.000
σ0.000
min2853.000-2868.000=-15.000
max2853.000-2868.000=-15.000
mean0.452-0.454=-0.002
σ0.303-0.299=0.005
min0.298-0.301=-0.003
max0.907-0.903=0.005
policies=20
mean1851.296-1851.268=0.028
σ0.377-0.379=-0.003
min1851.018-1850.977=0.041
max1851.841-1851.816=0.026
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2868.000=-15.000
σ0.000
min2853.000-2868.000=-15.000
max2853.000-2868.000=-15.000
mean2.953-2.965=-0.012
σ0.008-0.008=-0.000
min2.941-2.959=-0.017
max2.960-2.977=-0.017
policies=200
mean18519.485-18519.417=0.069
σ0.464-0.501=-0.037
min18519.150-18519.005=0.145
max18520.170-18520.135=0.035
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2868.000=-15.000
σ0.000
min2853.000-2868.000=-15.000
max2853.000-2868.000=-15.000
mean29.088-29.230=-0.142
σ0.440-0.413=0.027
min28.822-28.952=-0.131
max29.741-29.843=-0.102