Compare commits

Home / Compare 04cb104c .. ea6e3b5d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.005-54.007=-0.002
σ0.367-0.367=-0.000
min53.872-53.878=-0.005
max55.049-55.052=-0.003
mean415.100-419.000=-3.900
σ0.316-0.000=0.316
min415.000-419.000=-4.000
max416.000-419.000=-3.000
mean0.138-0.139=-0.001
σ0.006-0.005=0.000
min0.131-0.131=-0.000
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.213-43.212=0.000
σ0.008-0.005=0.003
min43.199-43.207=-0.008
max43.231-43.220=0.011
mean416.000-419.100=-3.100
σ0.000-0.316=-0.316
min416.000-419.000=-3.000
max416.000-420.000=-4.000
mean0.121-0.121=-0.000
σ0.003-0.004=-0.001
min0.118-0.119=-0.001
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.356-992.349=0.007
σ1.255-1.260=-0.005
min991.797-991.797=0.000
max997.639-997.654=-0.015
mean1068.650-1066.300=2.350
σ303.571-295.687=7.884
min665.000-669.000=-4.000
max1627.000-1600.000=27.000
mean1.537-1.553=-0.015
σ0.122-0.110=0.012
min1.416-1.456=-0.040
max1.990-1.820=0.170

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.358-287.359=-0.001
σ0.015-0.014=0.001
min287.333-287.339=-0.005
max287.375-287.373=0.002
mean1627.000-1600.000=27.000
σ0.000
min1627.000-1600.000=27.000
max1627.000-1600.000=27.000
mean0.378-0.373=0.005
σ0.005-0.004=0.000
min0.373-0.370=0.003
max0.383-0.379=0.004
iters=5
new-facts=1
prior-facts=6402
mean1287.314-1287.321=-0.007
σ0.117-0.136=-0.019
min1287.254-1287.256=-0.002
max1287.523-1287.564=-0.042
mean1627.000-1600.000=27.000
σ0.000
min1627.000-1600.000=27.000
max1627.000-1600.000=27.000
mean1.852-1.854=-0.003
σ0.044-0.035=0.009
min1.809-1.808=0.002
max1.902-1.886=0.016
iters=5
new-facts=6402
prior-facts=1
mean1809.656-1809.698=-0.042
σ7.028-6.988=0.041
min1806.282-1806.327=-0.045
max1822.215-1822.180=0.035
mean1627.000-1600.000=27.000
σ0.000
min1627.000-1600.000=27.000
max1627.000-1600.000=27.000
mean4.186-4.293=-0.107
σ0.267-0.203=0.064
min3.885-4.102=-0.217
max4.473-4.582=-0.109
iters=5
new-facts=6402
prior-facts=6402
mean2072.158-2072.161=-0.003
σ0.008-0.008=0.000
min2072.150-2072.154=-0.004
max2072.171-2072.174=-0.003
mean1849.400-1863.800=-14.400
σ206.851-212.296=-5.445
min1627.000-1600.000=27.000
max2085.000-2097.000=-12.000
mean4.895-4.894=0.001
σ0.179-0.172=0.007
min4.604-4.644=-0.040
max5.087-5.120=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.233=-0.035
σ0.284-0.376=-0.092
min0.916-0.903=0.014
max1.563-1.823=-0.260

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.410-437.414=-0.004
σ572.407-572.402=0.005
min151.203-151.205=-0.002
max1296.021-1296.017=0.004
mean90.250
σ8.500
min86.000
max103.000
mean1627.000-1600.000=27.000
σ0.000
min1627.000-1600.000=27.000
max1627.000-1600.000=27.000
mean0.532-0.547=-0.015
σ0.559-0.585=-0.026
min0.249-0.254=-0.005
max1.370-1.424=-0.054
policies=20
mean1512.316-1512.315=0.001
σ0.230-0.230=-0.000
min1512.170-1512.169=0.001
max1512.660-1512.659=0.001
mean860.000
σ0.000
min860.000
max860.000
mean1627.000-1600.000=27.000
σ0.000
min1627.000-1600.000=27.000
max1627.000-1600.000=27.000
mean2.512-2.511=0.000
σ0.025-0.020=0.005
min2.492-2.488=0.003
max2.548-2.537=0.011
policies=200
mean15130.788-15130.779=0.010
σ0.131-0.126=0.004
min15130.648-15130.656=-0.008
max15130.941-15130.915=0.025
mean8600.000
σ0.000
min8600.000
max8600.000
mean1627.000-1600.000=27.000
σ0.000
min1627.000-1600.000=27.000
max1627.000-1600.000=27.000
mean25.467-25.689=-0.222
σ0.217-0.284=-0.066
min25.300-25.435=-0.135
max25.773-26.076=-0.303