Compare commits

Home / Compare 3602d2bf .. d52560fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.565=-0.001
σ0.043-0.050=-0.007
min70.543-70.539=0.005
max70.686-70.707=-0.021
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.161-0.160=0.002
σ0.003-0.004=-0.002
min0.158-0.153=0.006
max0.167-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.292=-0.004
σ0.002-0.012=-0.010
min21.283-21.283=0.000
max21.290-21.325=-0.035
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.063-0.064=-0.000
σ0.003-0.002=0.001
min0.058-0.060=-0.002
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.571-1753.571=0.000
σ0.361-0.362=-0.001
min1753.000-1752.997=0.004
max1754.156-1754.149=0.006
mean1656.850-1640.900=15.950
σ644.086-600.952=43.133
min629.000-643.000=-14.000
max2898.000-2424.000=474.000
mean2.825-2.782=0.043
σ0.164-0.209=-0.044
min2.369-2.273=0.096
max3.049-3.096=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-272.012=0.004
σ0.006-0.009=-0.003
min272.007-271.998=0.008
max272.022-272.021=0.000
mean2898.000-2424.000=474.000
σ0.000
min2898.000-2424.000=474.000
max2898.000-2424.000=474.000
mean0.388-0.386=0.002
σ0.010-0.010=-0.000
min0.378-0.377=0.001
max0.402-0.400=0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.434-1932.439=-0.005
σ0.008-0.004=0.003
min1932.423-1932.433=-0.010
max1932.442-1932.445=-0.002
mean2898.000-2424.000=474.000
σ0.000
min2898.000-2424.000=474.000
max2898.000-2424.000=474.000
mean2.982-3.010=-0.028
σ0.065-0.058=0.007
min2.908-2.950=-0.042
max3.086-3.102=-0.017
iters=5
new-facts=6402
prior-facts=1
mean4753.137-4752.924=0.213
σ0.854-0.719=0.134
min4752.692-4752.152=0.540
max4754.661-4754.090=0.571
mean2898.000-2424.000=474.000
σ0.000
min2898.000-2424.000=474.000
max2898.000-2424.000=474.000
mean8.928-8.765=0.162
σ0.316-0.418=-0.101
min8.462-8.459=0.003
max9.230-9.454=-0.224
iters=5
new-facts=6402
prior-facts=6402
mean4943.494-4943.487=0.007
σ0.190-0.187=0.003
min4943.278-4943.273=0.005
max4943.669-4943.637=0.032
mean3038.800-2994.000=44.800
σ169.856-285.159=-115.302
min2898.000-2611.000=287.000
max3314.000-3332.000=-18.000
mean8.643-8.624=0.019
σ0.397-0.239=0.158
min8.326-8.398=-0.071
max9.318-9.028=0.290

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.825=-0.803
σ0.146-0.092=0.055
min0.924-1.738=-0.814
max1.258-1.978=-0.719

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.081-473.068=0.013
σ575.915-575.911=0.004
min185.114-185.106=0.009
max1336.953-1336.934=0.019
mean88.250
σ8.500
min84.000
max101.000
mean2898.000-2424.000=474.000
σ0.000
min2898.000-2424.000=474.000
max2898.000-2424.000=474.000
mean0.487-0.551=-0.064
σ0.375-0.526=-0.152
min0.297-0.284=0.013
max1.049-1.340=-0.291
policies=20
mean1851.465-1851.399=0.066
σ0.373-0.387=-0.014
min1851.182-1851.127=0.055
max1852.006-1851.967=0.040
mean840.000
σ0.000
min840.000
max840.000
mean2898.000-2424.000=474.000
σ0.000
min2898.000-2424.000=474.000
max2898.000-2424.000=474.000
mean2.948-2.875=0.073
σ0.010-0.026=-0.016
min2.940-2.847=0.092
max2.963-2.909=0.054
policies=200
mean18521.097-18521.036=0.061
σ0.551-0.474=0.077
min18520.772-18520.685=0.086
max18521.920-18521.731=0.189
mean8400.000
σ0.000
min8400.000
max8400.000
mean2898.000-2424.000=474.000
σ0.000
min2898.000-2424.000=474.000
max2898.000-2424.000=474.000
mean29.218-28.779=0.439
σ0.521-0.104=0.417
min28.740-28.665=0.076
max29.778-28.908=0.870