Compare commits

Home / Compare 09e6000c .. 2a958ab0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.695=0.001
σ0.044-0.046=-0.002
min70.671-70.669=0.002
max70.820-70.825=-0.005
mean414.900-417.000=-2.100
σ0.316-0.000=0.316
min414.000-417.000=-3.000
max415.000-417.000=-2.000
mean0.160-0.160=0.000
σ0.003-0.004=-0.001
min0.156-0.156=-0.000
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.420-21.421=-0.001
σ0.003-0.002=0.001
min21.415-21.417=-0.002
max21.425-21.425=0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.062-0.066=-0.004
σ0.003-0.003=0.000
min0.059-0.063=-0.004
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.461-1754.458=0.003
σ0.360-0.359=0.001
min1753.885-1753.892=-0.007
max1755.040-1755.037=0.003
mean1674.900-1644.150=30.750
σ652.524-627.901=24.624
min626.000-627.000=-1.000
max2870.000-2858.000=12.000
mean2.857-2.797=0.060
σ0.061-0.197=-0.137
min2.750-2.145=0.605
max2.951-2.967=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.506-273.505=0.001
σ0.006-0.006=-0.001
min273.500-273.495=0.005
max273.515-273.511=0.004
mean2870.000-2858.000=12.000
σ0.000
min2870.000-2858.000=12.000
max2870.000-2858.000=12.000
mean0.385-0.379=0.007
σ0.005-0.009=-0.004
min0.381-0.371=0.010
max0.393-0.391=0.002
iters=5
new-facts=1
prior-facts=6402
mean1793.629-1933.893=-140.264
σ313.660-0.005=313.655
min1232.537-1933.888=-701.351
max1933.937-1933.902=0.036
mean2870.000-2858.000=12.000
σ0.000
min2870.000-2858.000=12.000
max2870.000-2858.000=12.000
mean2.905-3.027=-0.122
σ0.693-0.048=0.645
min1.672-2.977=-1.304
max3.321-3.099=0.222
iters=5
new-facts=6402
prior-facts=1
mean4754.703-4754.743=-0.040
σ0.806-0.775=0.031
min4754.195-4754.336=-0.141
max4756.135-4756.128=0.008
mean2870.000-2858.000=12.000
σ0.000
min2870.000-2858.000=12.000
max2870.000-2858.000=12.000
mean8.087-8.111=-0.024
σ0.484-0.338=0.147
min7.714-7.804=-0.090
max8.823-8.503=0.320
iters=5
new-facts=6402
prior-facts=6402
mean4945.049-4945.045=0.004
σ0.166-0.154=0.012
min4944.754-4944.770=-0.016
max4945.138-4945.135=0.003
mean3032.200-3072.000=-39.800
σ225.444-287.482=-62.038
min2870.000-2858.000=12.000
max3354.000-3520.000=-166.000
mean8.577-8.422=0.154
σ0.106-0.106=0.000
min8.438-8.340=0.098
max8.695-8.600=0.095

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.039=-0.016
σ0.137-0.244=-0.107
min0.932-0.928=0.004
max1.248-1.475=-0.227

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.075-473.083=-0.008
σ575.910-575.919=-0.009
min185.113-185.115=-0.002
max1336.940-1336.961=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2870.000-2858.000=12.000
σ0.000
min2870.000-2858.000=12.000
max2870.000-2858.000=12.000
mean0.487-0.448=0.038
σ0.376-0.298=0.078
min0.297-0.297=0.000
max1.051-0.896=0.155
policies=20
mean1851.424-1851.451=-0.027
σ0.375-0.370=0.005
min1851.153-1851.178=-0.025
max1851.973-1851.989=-0.016
mean840.000
σ0.000
min840.000
max840.000
mean2870.000-2858.000=12.000
σ0.000
min2870.000-2858.000=12.000
max2870.000-2858.000=12.000
mean2.934-2.937=-0.003
σ0.025-0.011=0.014
min2.897-2.921=-0.024
max2.952-2.946=0.006
policies=200
mean18519.886-18519.901=-0.014
σ0.750-0.762=-0.012
min18519.197-18519.208=-0.010
max18520.792-18520.839=-0.047
mean8400.000
σ0.000
min8400.000
max8400.000
mean2870.000-2858.000=12.000
σ0.000
min2870.000-2858.000=12.000
max2870.000-2858.000=12.000
mean29.162-29.113=0.049
σ0.503-0.475=0.028
min28.741-28.726=0.015
max29.836-29.787=0.049