Compare commits

Home / Compare 9f2509fd .. 9c1cb663

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.692-55.691=0.001
σ0.051-0.053=-0.002
min55.654-55.657=-0.003
max55.831-55.838=-0.006
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.136-0.138=-0.002
σ0.005-0.005=0.000
min0.129-0.134=-0.005
max0.144-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean44.205-44.203=0.002
σ0.005-0.005=0.000
min44.196-44.197=-0.001
max44.211-44.212=-0.002
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.118-0.120=-0.002
σ0.005-0.004=0.001
min0.113-0.115=-0.002
max0.125-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1763.720-1763.721=-0.001
σ0.366-0.366=-0.000
min1763.143-1763.144=-0.001
max1764.311-1764.304=0.007
mean1645.050-1648.650=-3.600
σ639.371-635.220=4.151
min643.000-644.000=-1.000
max2844.000-2836.000=8.000
mean2.346-2.355=-0.010
σ0.083-0.114=-0.031
min2.207-2.201=0.006
max2.559-2.677=-0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean343.136-343.136=0.000
σ0.068-0.070=-0.002
min343.014-343.012=0.002
max343.174-343.179=-0.005
mean2844.000-2836.000=8.000
σ0.000
min2844.000-2836.000=8.000
max2844.000-2836.000=8.000
mean0.438-0.442=-0.004
σ0.005-0.006=-0.001
min0.434-0.437=-0.003
max0.447-0.450=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2003.700-2003.698=0.003
σ0.014-0.021=-0.007
min2003.681-2003.670=0.011
max2003.713-2003.718=-0.004
mean2844.000-2836.000=8.000
σ0.000
min2844.000-2836.000=8.000
max2844.000-2836.000=8.000
mean2.726-2.668=0.057
σ0.168-0.148=0.019
min2.551-2.508=0.043
max2.968-2.849=0.119
iters=5
new-facts=6402
prior-facts=1
mean4827.423-4827.302=0.120
σ7.733-7.829=-0.095
min4823.753-4823.197=0.556
max4841.251-4841.290=-0.039
mean2844.000-2836.000=8.000
σ0.000
min2844.000-2836.000=8.000
max2844.000-2836.000=8.000
mean8.622-8.446=0.176
σ0.976-0.861=0.115
min7.779-7.774=0.005
max9.986-9.460=0.526
iters=5
new-facts=6402
prior-facts=6402
mean5014.916-5014.772=0.144
σ0.031-0.336=-0.305
min5014.876-5014.171=0.705
max5014.953-5014.942=0.012
mean3059.000-3062.600=-3.600
σ288.020-296.872=-8.852
min2844.000-2836.000=8.000
max3505.000-3520.000=-15.000
mean8.496-8.492=0.003
σ0.101-0.116=-0.015
min8.365-8.375=-0.010
max8.635-8.667=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.956-0.980=-0.024
σ0.061-0.068=-0.007
min0.920-0.920=-0.000
max1.062-1.058=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.045-465.048=-0.003
σ574.250-574.248=0.001
min177.913-177.922=-0.009
max1326.420-1326.421=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2844.000-2836.000=8.000
σ0.000
min2844.000-2836.000=8.000
max2844.000-2836.000=8.000
mean0.421-0.402=0.019
σ0.292-0.224=0.068
min0.253-0.288=-0.034
max0.858-0.737=0.121
policies=20
mean1779.499-1779.485=0.014
σ0.365-0.367=-0.002
min1779.275-1779.268=0.008
max1780.041-1780.032=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2844.000-2836.000=8.000
σ0.000
min2844.000-2836.000=8.000
max2844.000-2836.000=8.000
mean2.839-2.829=0.010
σ0.002-0.022=-0.020
min2.836-2.796=0.040
max2.841-2.842=-0.001
policies=200
mean17801.168-17801.137=0.031
σ0.688-0.714=-0.026
min17800.194-17800.180=0.015
max17801.669-17801.706=-0.037
mean8400.000
σ0.000
min8400.000
max8400.000
mean2844.000-2836.000=8.000
σ0.000
min2844.000-2836.000=8.000
max2844.000-2836.000=8.000
mean28.273-28.371=-0.099
σ0.382-0.375=0.007
min27.899-28.054=-0.155
max28.723-28.817=-0.094