Compare commits

Home / Compare 1b95ddf1 .. 7f43ccb4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.108-73.112=-0.004
σ0.046-0.047=-0.002
min73.082-73.088=-0.006
max73.237-73.246=-0.010
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.158-0.166=-0.008
σ0.005-0.009=-0.004
min0.150-0.159=-0.009
max0.165-0.182=-0.017
cache=y
dps=1
iters=10
policies=100
mean23.740-23.739=0.000
σ0.002-0.003=-0.001
min23.737-23.734=0.003
max23.744-23.744=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.064=-0.000
σ0.003-0.005=-0.001
min0.060-0.059=0.001
max0.071-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.793-1758.792=0.002
σ0.361-0.360=0.001
min1758.221-1758.215=0.006
max1759.376-1759.378=-0.002
mean1656.400-1641.000=15.400
σ631.294-626.132=5.162
min618.000-622.000=-4.000
max2888.000-2773.000=115.000
mean2.870-2.894=-0.024
σ0.102-0.113=-0.011
min2.668-2.705=-0.037
max3.072-3.155=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.021-324.012=0.009
σ0.050-0.055=-0.005
min323.931-323.913=0.019
max324.047-324.038=0.009
mean2888.000-2773.000=115.000
σ0.000
min2888.000-2773.000=115.000
max2888.000-2773.000=115.000
mean0.428-0.425=0.003
σ0.004-0.001=0.003
min0.425-0.423=0.002
max0.435-0.427=0.008
iters=5
new-facts=1
prior-facts=6402
mean1984.595-1984.585=0.010
σ0.017-0.023=-0.006
min1984.574-1984.561=0.014
max1984.611-1984.608=0.003
mean2888.000-2773.000=115.000
σ0.000
min2888.000-2773.000=115.000
max2888.000-2773.000=115.000
mean2.668-2.654=0.014
σ0.140-0.111=0.029
min2.582-2.558=0.024
max2.912-2.794=0.118
iters=5
new-facts=6402
prior-facts=1
mean4808.243-4808.037=0.206
σ7.761-7.866=-0.105
min4804.702-4803.617=1.085
max4822.126-4822.076=0.049
mean2888.000-2773.000=115.000
σ0.000
min2888.000-2773.000=115.000
max2888.000-2773.000=115.000
mean8.758-8.580=0.178
σ0.306-0.362=-0.056
min8.447-8.116=0.331
max9.134-8.978=0.155
iters=5
new-facts=6402
prior-facts=6402
mean4995.801-4995.740=0.061
σ0.025-0.160=-0.135
min4995.775-4995.458=0.317
max4995.838-4995.843=-0.005
mean3091.200-3048.600=42.600
σ299.271-344.175=-44.904
min2888.000-2773.000=115.000
max3564.000-3570.000=-6.000
mean8.512-8.498=0.015
σ0.108-0.118=-0.010
min8.449-8.406=0.043
max8.704-8.690=0.014

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-0.999=0.071
σ0.115-0.195=-0.080
min0.924-0.905=0.019
max1.248-1.348=-0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.364-468.364=-0.000
σ574.254-574.245=0.009
min181.229-181.234=-0.005
max1329.745-1329.732=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2888.000-2773.000=115.000
σ0.000
min2888.000-2773.000=115.000
max2888.000-2773.000=115.000
mean0.444-0.440=0.004
σ0.305-0.300=0.005
min0.290-0.287=0.003
max0.903-0.891=0.012
policies=20
mean1812.649-1812.617=0.031
σ0.408-0.375=0.033
min1812.343-1812.378=-0.034
max1813.244-1813.172=0.072
mean840.000
σ0.000
min840.000
max840.000
mean2888.000-2773.000=115.000
σ0.000
min2888.000-2773.000=115.000
max2888.000-2773.000=115.000
mean2.871-2.870=0.000
σ0.010-0.003=0.006
min2.857-2.867=-0.010
max2.878-2.874=0.004
policies=200
mean18132.707-18131.625=1.082
σ0.699-0.479=0.219
min18131.792-18131.259=0.533
max18133.301-18132.317=0.983
mean8400.000
σ0.000
min8400.000
max8400.000
mean2888.000-2773.000=115.000
σ0.000
min2888.000-2773.000=115.000
max2888.000-2773.000=115.000
mean28.771-28.343=0.428
σ0.414-0.278=0.136
min28.313-28.099=0.214
max29.150-28.739=0.411