Compare commits

Home / Compare e4ca23f3 .. cd020e8e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.027-73.024=0.003
σ0.047-0.047=-0.001
min72.995-72.995=0.000
max73.157-73.157=0.000
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.163-0.158=0.005
σ0.003-0.006=-0.004
min0.160-0.149=0.012
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean23.724-23.723=0.001
σ0.002-0.003=-0.001
min23.722-23.719=0.003
max23.728-23.729=-0.001
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.064-0.064=-0.001
σ0.003-0.004=-0.000
min0.060-0.060=-0.001
max0.068-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.785-1758.786=-0.000
σ0.359-0.365=-0.006
min1758.209-1758.219=-0.010
max1759.367-1759.384=-0.017
mean1662.800-1665.100=-2.300
σ626.617-630.011=-3.394
min626.000-638.000=-12.000
max2521.000-2529.000=-8.000
mean2.843-2.827=0.016
σ0.108-0.169=-0.062
min2.571-2.176=0.395
max3.039-3.024=0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.008=0.004
σ0.055-0.060=-0.005
min323.914-323.901=0.014
max324.040-324.038=0.003
mean2521.000-2529.000=-8.000
σ0.000
min2521.000-2529.000=-8.000
max2521.000-2529.000=-8.000
mean0.431-0.430=0.001
σ0.007-0.007=-0.001
min0.425-0.424=0.002
max0.441-0.440=0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.587-1984.593=-0.007
σ0.025-0.007=0.018
min1984.554-1984.587=-0.033
max1984.613-1984.606=0.007
mean2521.000-2529.000=-8.000
σ0.000
min2521.000-2529.000=-8.000
max2521.000-2529.000=-8.000
mean2.604-2.605=-0.001
σ0.062-0.076=-0.014
min2.551-2.552=-0.001
max2.701-2.735=-0.034
iters=5
new-facts=6402
prior-facts=1
mean4808.123-4808.224=-0.101
σ7.851-7.837=0.014
min4804.112-4804.677=-0.565
max4822.157-4822.243=-0.086
mean2521.000-2529.000=-8.000
σ0.000
min2521.000-2529.000=-8.000
max2521.000-2529.000=-8.000
mean8.837-8.947=-0.109
σ0.258-0.219=0.040
min8.590-8.709=-0.119
max9.162-9.237=-0.075
iters=5
new-facts=6402
prior-facts=6402
mean4995.800-4995.801=-0.001
σ0.020-0.020=0.001
min4995.775-4995.776=-0.000
max4995.822-4995.820=0.002
mean2970.600-2993.600=-23.000
σ263.285-287.099=-23.814
min2638.000-2596.000=42.000
max3323.000-3333.000=-10.000
mean8.538-8.533=0.006
σ0.079-0.138=-0.059
min8.432-8.377=0.055
max8.640-8.715=-0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.610-1.616=-0.007
σ0.267-0.088=0.179
min1.240-1.529=-0.289
max1.828-1.747=0.081

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.321-468.323=-0.002
σ574.233-574.231=0.002
min181.199-181.204=-0.005
max1329.671-1329.670=0.001
mean88.250
σ8.500
min84.000
max101.000
mean2521.000-2529.000=-8.000
σ0.000
min2521.000-2529.000=-8.000
max2521.000-2529.000=-8.000
mean0.566-0.565=0.002
σ0.566-0.566=0.000
min0.280-0.279=0.001
max1.416-1.414=0.002
policies=20
mean1812.385-1812.391=-0.006
σ0.398-0.404=-0.006
min1812.104-1812.120=-0.016
max1812.969-1812.989=-0.019
mean840.000
σ0.000
min840.000
max840.000
mean2521.000-2529.000=-8.000
σ0.000
min2521.000-2529.000=-8.000
max2521.000-2529.000=-8.000
mean2.843-2.804=0.039
σ0.045-0.009=0.036
min2.799-2.797=0.003
max2.901-2.817=0.084
policies=200
mean18131.287-18131.199=0.088
σ0.539-0.410=0.130
min18130.901-18130.898=0.003
max18132.069-18131.770=0.299
mean8400.000
σ0.000
min8400.000
max8400.000
mean2521.000-2529.000=-8.000
σ0.000
min2521.000-2529.000=-8.000
max2521.000-2529.000=-8.000
mean28.322-28.282=0.039
σ0.100-0.190=-0.090
min28.181-28.089=0.092
max28.418-28.538=-0.120