Compare commits

Home / Compare 3044c14e .. 02f4eaf2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.769=-0.001
σ0.049-0.048=0.001
min30.725-30.732=-0.007
max30.904-30.902=0.002
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.076-0.078=-0.002
σ0.005-0.003=0.002
min0.069-0.076=-0.007
max0.086-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.002=0.000
min21.057-21.058=-0.001
max21.064-21.066=-0.002
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.061-0.065=-0.004
σ0.003-0.004=-0.001
min0.058-0.062=-0.004
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.419=0.001
σ0.361-0.362=-0.001
min1750.848-1750.849=-0.001
max1752.001-1752.002=-0.002
mean1659.150-1649.250=9.900
σ621.871-625.185=-3.314
min640.000-678.000=-38.000
max2505.000-2651.000=-146.000
mean2.779-2.846=-0.067
σ0.132-0.137=-0.006
min2.347-2.585=-0.237
max2.922-3.216=-0.294

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.753-275.757=-0.004
σ0.014-0.010=0.004
min275.738-275.745=-0.006
max275.772-275.767=0.005
mean2505.000-2651.000=-146.000
σ0.000
min2505.000-2651.000=-146.000
max2505.000-2651.000=-146.000
mean0.394-0.396=-0.001
σ0.009-0.011=-0.002
min0.387-0.387=0.000
max0.408-0.409=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.285-2168.277=0.008
σ0.006-0.019=-0.013
min2168.279-2168.248=0.031
max2168.295-2168.295=-0.000
mean2505.000-2651.000=-146.000
σ0.000
min2505.000-2651.000=-146.000
max2505.000-2651.000=-146.000
mean2.936-2.883=0.053
σ0.127-0.258=-0.131
min2.762-2.619=0.143
max3.092-3.282=-0.190
iters=5
new-facts=6402
prior-facts=1
mean5048.042-5048.110=-0.069
σ1.062-0.890=0.172
min5046.944-5047.590=-0.647
max5049.809-5049.690=0.119
mean2505.000-2651.000=-146.000
σ0.000
min2505.000-2651.000=-146.000
max2505.000-2651.000=-146.000
mean9.007-8.836=0.171
σ0.857-0.527=0.331
min8.064-8.044=0.020
max10.148-9.460=0.689
iters=5
new-facts=6402
prior-facts=6402
mean5179.245-5179.227=0.018
σ0.082-0.079=0.003
min5179.169-5179.155=0.015
max5179.341-5179.315=0.026
mean3264.200-3258.000=6.200
σ378.325-461.522=-83.198
min2732.000-2653.000=79.000
max3726.000-3873.000=-147.000
mean10.038-9.872=0.166
σ0.192-0.200=-0.008
min9.708-9.636=0.072
max10.175-10.129=0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.702-1.227=0.476
σ0.167-0.273=-0.106
min1.425-0.953=0.472
max1.873-1.631=0.243

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.567-463.576=-0.009
σ572.653-572.662=-0.009
min177.235-177.240=-0.004
max1322.547-1322.569=-0.023
mean79.750
σ7.500
min76.000
max91.000
mean2505.000-2651.000=-146.000
σ0.000
min2505.000-2651.000=-146.000
max2505.000-2651.000=-146.000
mean0.561-0.557=0.004
σ0.559-0.553=0.007
min0.278-0.278=-0.000
max1.400-1.386=0.014
policies=20
mean1772.633-1772.644=-0.011
σ0.317-0.331=-0.014
min1772.417-1772.412=0.005
max1773.103-1773.134=-0.031
mean760.000
σ0.000
min760.000
max760.000
mean2505.000-2651.000=-146.000
σ0.000
min2505.000-2651.000=-146.000
max2505.000-2651.000=-146.000
mean2.754-2.744=0.009
σ0.008-0.012=-0.003
min2.745-2.734=0.011
max2.765-2.761=0.004
policies=200
mean17732.887-17733.023=-0.136
σ0.613-0.439=0.173
min17732.495-17732.757=-0.262
max17733.790-17733.677=0.113
mean7600.000
σ0.000
min7600.000
max7600.000
mean2505.000-2651.000=-146.000
σ0.000
min2505.000-2651.000=-146.000
max2505.000-2651.000=-146.000
mean27.704-27.677=0.027
σ0.162-0.069=0.093
min27.522-27.621=-0.099
max27.916-27.764=0.152