Compare commits

Home / Compare c1012f19 .. 585070cd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.787-70.788=-0.000
σ0.045-0.047=-0.002
min70.756-70.758=-0.002
max70.913-70.919=-0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.161-0.156=0.005
σ0.003-0.005=-0.002
min0.158-0.149=0.009
max0.168-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.496-21.496=0.000
σ0.003-0.004=-0.001
min21.490-21.491=-0.001
max21.500-21.503=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.062=0.001
σ0.003-0.003=-0.000
min0.059-0.059=0.000
max0.067-0.067=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.096=-0.003
σ0.360-0.361=-0.001
min1753.520-1753.533=-0.014
max1754.685-1754.679=0.006
mean1667.000-1669.450=-2.450
σ637.576-640.983=-3.408
min683.000-630.000=53.000
max2728.000-2731.000=-3.000
mean2.791-2.851=-0.059
σ0.159-0.160=-0.001
min2.444-2.494=-0.050
max3.016-3.115=-0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.953-271.956=-0.002
σ0.009-0.008=0.001
min271.944-271.948=-0.005
max271.965-271.966=-0.001
mean2728.000-2731.000=-3.000
σ0.000
min2728.000-2731.000=-3.000
max2728.000-2731.000=-3.000
mean0.383-0.386=-0.003
σ0.008-0.010=-0.002
min0.378-0.378=-0.000
max0.398-0.398=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.331-1932.330=0.001
σ0.005-0.012=-0.007
min1932.326-1932.315=0.011
max1932.337-1932.346=-0.009
mean2728.000-2731.000=-3.000
σ0.000
min2728.000-2731.000=-3.000
max2728.000-2731.000=-3.000
mean2.972-3.014=-0.041
σ0.144-0.229=-0.086
min2.734-2.662=0.072
max3.125-3.275=-0.150
iters=5
new-facts=6402
prior-facts=1
mean4753.056-4753.045=0.011
σ0.907-0.918=-0.011
min4752.531-4752.556=-0.026
max4754.673-4754.679=-0.006
mean2728.000-2731.000=-3.000
σ0.000
min2728.000-2731.000=-3.000
max2728.000-2731.000=-3.000
mean8.686-8.751=-0.065
σ0.510-0.472=0.038
min7.873-8.017=-0.144
max9.195-9.114=0.080
iters=5
new-facts=6402
prior-facts=6402
mean4943.486-4943.482=0.003
σ0.162-0.144=0.018
min4943.197-4943.225=-0.029
max4943.574-4943.573=0.001
mean2980.600-2979.200=1.400
σ226.886-220.222=6.664
min2728.000-2731.000=-3.000
max3307.000-3292.000=15.000
mean8.486-8.537=-0.051
σ0.129-0.156=-0.027
min8.364-8.396=-0.031
max8.699-8.803=-0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.044=0.008
σ0.135-0.134=0.001
min0.929-0.923=0.006
max1.261-1.251=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.664-468.663=0.000
σ574.938-574.938=-0.000
min181.186-181.194=-0.008
max1331.070-1331.070=0.000
mean88.250
σ8.500
min84.000
max101.000
mean2728.000-2731.000=-3.000
σ0.000
min2728.000-2731.000=-3.000
max2728.000-2731.000=-3.000
mean0.584-0.543=0.041
σ0.586-0.505=0.081
min0.283-0.279=0.003
max1.463-1.300=0.163
policies=20
mean1812.192-1812.224=-0.032
σ0.384-0.388=-0.004
min1811.927-1811.968=-0.041
max1812.759-1812.800=-0.041
mean840.000
σ0.000
min840.000
max840.000
mean2728.000-2731.000=-3.000
σ0.000
min2728.000-2731.000=-3.000
max2728.000-2731.000=-3.000
mean2.841-2.844=-0.002
σ0.014-0.035=-0.021
min2.825-2.809=0.017
max2.857-2.884=-0.027
policies=200
mean18129.122-18129.195=-0.074
σ0.585-0.399=0.186
min18128.783-18128.868=-0.085
max18129.995-18129.775=0.221
mean8400.000
σ0.000
min8400.000
max8400.000
mean2728.000-2731.000=-3.000
σ0.000
min2728.000-2731.000=-3.000
max2728.000-2731.000=-3.000
mean28.526-28.455=0.071
σ0.084-0.070=0.014
min28.465-28.356=0.108
max28.649-28.516=0.133