Compare commits

Home / Compare 05727f16 .. 84030a77

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.697=0.002
σ0.047-0.047=-0.000
min70.665-70.667=-0.002
max70.829-70.828=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.160-0.158=0.002
σ0.004-0.005=-0.001
min0.156-0.150=0.006
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.407=0.001
σ0.003-0.003=-0.000
min21.405-21.401=0.004
max21.413-21.412=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.063=0.003
σ0.003-0.003=-0.000
min0.063-0.059=0.004
max0.073-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.898-1754.896=0.001
σ0.358-0.360=-0.001
min1754.339-1754.337=0.001
max1755.482-1755.470=0.012
mean1646.700-1633.100=13.600
σ632.656-611.802=20.854
min619.000-632.000=-13.000
max2771.000-2458.000=313.000
mean2.842-2.798=0.044
σ0.216-0.186=0.030
min2.188-2.154=0.034
max3.193-2.985=0.208

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.758-272.759=-0.001
σ0.002-0.005=-0.003
min272.755-272.752=0.003
max272.760-272.765=-0.005
mean2771.000-2458.000=313.000
σ0.000
min2771.000-2458.000=313.000
max2771.000-2458.000=313.000
mean0.386-0.386=0.000
σ0.006-0.005=0.001
min0.381-0.382=-0.001
max0.394-0.393=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.131-1933.124=0.008
σ0.012-0.017=-0.005
min1933.115-1933.100=0.014
max1933.143-1933.146=-0.003
mean2771.000-2458.000=313.000
σ0.000
min2771.000-2458.000=313.000
max2771.000-2458.000=313.000
mean3.036-3.043=-0.007
σ0.040-0.054=-0.014
min2.993-2.993=0.001
max3.089-3.125=-0.036
iters=5
new-facts=6402
prior-facts=1
mean4754.098-4753.830=0.268
σ0.891-0.707=0.184
min4753.523-4753.164=0.359
max4755.678-4755.034=0.644
mean2771.000-2458.000=313.000
σ0.000
min2771.000-2458.000=313.000
max2771.000-2458.000=313.000
mean8.289-8.769=-0.480
σ0.507-0.309=0.198
min7.779-8.434=-0.655
max9.039-9.131=-0.092
iters=5
new-facts=6402
prior-facts=6402
mean4944.463-4944.455=0.008
σ0.011-0.007=0.004
min4944.449-4944.446=0.003
max4944.477-4944.464=0.013
mean2987.600-2905.800=81.800
σ211.214-386.476=-175.262
min2771.000-2458.000=313.000
max3294.000-3436.000=-142.000
mean8.531-8.399=0.132
σ0.096-0.056=0.040
min8.430-8.321=0.109
max8.655-8.451=0.204

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.824=-0.828
σ0.150-0.078=0.072
min0.927-1.709=-0.782
max1.265-1.885=-0.621

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.917-468.885=0.032
σ575.406-575.396=0.010
min181.199-181.185=0.014
max1332.026-1331.980=0.046
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2458.000=313.000
σ0.000
min2771.000-2458.000=313.000
max2771.000-2458.000=313.000
mean0.449-0.559=-0.110
σ0.301-0.540=-0.240
min0.298-0.288=0.010
max0.900-1.370=-0.470
policies=20
mean1812.290-1812.176=0.114
σ0.318-0.385=-0.067
min1812.108-1811.917=0.191
max1812.765-1812.742=0.023
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2458.000=313.000
σ0.000
min2771.000-2458.000=313.000
max2771.000-2458.000=313.000
mean2.928-2.842=0.086
σ0.101-0.019=0.082
min2.839-2.820=0.019
max3.070-2.864=0.205
policies=200
mean18129.264-18129.266=-0.002
σ0.520-0.470=0.051
min18128.834-18129.009=-0.175
max18130.021-18129.970=0.051
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2458.000=313.000
σ0.000
min2771.000-2458.000=313.000
max2771.000-2458.000=313.000
mean28.638-28.592=0.046
σ0.051-0.091=-0.040
min28.580-28.485=0.094
max28.701-28.708=-0.007