Compare commits

Home / Compare 23dca72f .. 5b25938f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.001
σ0.047-0.049=-0.001
min33.949-33.953=-0.004
max34.109-34.114=-0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.082-0.083=-0.001
σ0.005-0.004=0.001
min0.076-0.076=0.000
max0.090-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.316-23.317=-0.001
σ0.003-0.002=0.001
min23.312-23.315=-0.003
max23.321-23.321=-0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.064-0.065=-0.002
σ0.003-0.002=0.001
min0.059-0.064=-0.004
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.495-1757.493=0.002
σ0.365-0.364=0.001
min1756.919-1756.917=0.002
max1758.083-1758.077=0.007
mean1649.800-1650.100=-0.300
σ624.668-625.922=-1.254
min638.000
max2825.000-2832.000=-7.000
mean2.369-2.377=-0.008
σ0.085-0.083=0.002
min2.286-2.281=0.005
max2.641-2.638=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.715-326.707=0.008
σ0.036-0.048=-0.011
min326.652-326.623=0.029
max326.744-326.743=0.001
mean2825.000-2832.000=-7.000
σ0.000
min2825.000-2832.000=-7.000
max2825.000-2832.000=-7.000
mean0.423-0.422=0.000
σ0.001-0.001=0.001
min0.421-0.422=-0.001
max0.424-0.424=0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.864-1988.870=-0.005
σ0.022-0.016=0.006
min1988.832-1988.847=-0.016
max1988.881-1988.883=-0.002
mean2825.000-2832.000=-7.000
σ0.000
min2825.000-2832.000=-7.000
max2825.000-2832.000=-7.000
mean2.753-2.652=0.101
σ0.262-0.084=0.178
min2.579-2.547=0.032
max3.216-2.782=0.434
iters=5
new-facts=6402
prior-facts=1
mean4813.602-4813.715=-0.114
σ7.785-7.726=0.059
min4809.714-4810.214=-0.501
max4827.522-4827.536=-0.014
mean2825.000-2832.000=-7.000
σ0.000
min2825.000-2832.000=-7.000
max2825.000-2832.000=-7.000
mean8.580-8.904=-0.324
σ0.314-0.257=0.057
min8.125-8.456=-0.331
max8.998-9.071=-0.074
iters=5
new-facts=6402
prior-facts=6402
mean5001.282-5001.197=0.086
σ0.037-0.165=-0.127
min5001.247-5000.904=0.343
max5001.343-5001.296=0.047
mean3037.400-3028.600=8.800
σ208.233-201.985=6.248
min2825.000-2832.000=-7.000
max3303.000-3311.000=-8.000
mean9.737-9.205=0.531
σ0.400-0.687=-0.287
min9.165-8.449=0.716
max10.271-9.884=0.387

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.982-0.949=0.033
σ0.066-0.056=0.010
min0.925-0.913=0.012
max1.055-1.046=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.636-464.631=0.005
σ574.771-574.772=-0.001
min177.238-177.237=0.001
max1326.793-1326.789=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2825.000-2832.000=-7.000
σ0.000
min2825.000-2832.000=-7.000
max2825.000-2832.000=-7.000
mean0.434-0.436=-0.003
σ0.307-0.304=0.003
min0.277-0.283=-0.005
max0.895-0.893=0.002
policies=20
mean1772.706-1772.683=0.022
σ0.366-0.361=0.005
min1772.463-1772.437=0.025
max1773.250-1773.218=0.032
mean840.000
σ0.000
min840.000
max840.000
mean2825.000-2832.000=-7.000
σ0.000
min2825.000-2832.000=-7.000
max2825.000-2832.000=-7.000
mean2.779-2.796=-0.017
σ0.005-0.006=-0.001
min2.774-2.788=-0.014
max2.786-2.803=-0.017
policies=200
mean17733.952-17734.035=-0.083
σ0.092-0.535=-0.443
min17733.822-17733.699=0.123
max17734.039-17734.834=-0.795
mean8400.000
σ0.000
min8400.000
max8400.000
mean2825.000-2832.000=-7.000
σ0.000
min2825.000-2832.000=-7.000
max2825.000-2832.000=-7.000
mean27.928-27.885=0.043
σ0.352-0.406=-0.054
min27.587-27.517=0.071
max28.345-28.317=0.028