Compare commits

Home / Compare 6e91350e .. 97691288

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.244=0.001
σ0.054-0.053=0.001
min35.219-35.217=0.003
max35.398-35.395=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.083-0.085=-0.002
σ0.005-0.003=0.002
min0.077-0.081=-0.004
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=0.001
min23.765-23.766=-0.001
max23.774-23.772=0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.069-0.065=0.003
σ0.003-0.004=-0.000
min0.066-0.061=0.005
max0.076-0.072=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.364=0.000
σ0.365-0.365=-0.001
min1755.789-1755.789=0.000
max1756.950-1756.957=-0.007
mean1652.700-1645.250=7.450
σ643.626-634.024=9.602
min627.000-626.000=1.000
max2840.000-2828.000=12.000
mean2.327-2.349=-0.022
σ0.081-0.086=-0.005
min2.247-2.251=-0.005
max2.550-2.609=-0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.581-324.586=-0.006
σ0.052-0.052=0.000
min324.488-324.496=-0.008
max324.611-324.625=-0.013
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean0.426-0.429=-0.003
σ0.006-0.006=-0.001
min0.422-0.423=-0.001
max0.436-0.438=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.138-1985.140=-0.003
σ0.012-0.013=-0.001
min1985.127-1985.125=0.002
max1985.155-1985.157=-0.002
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean2.641-2.753=-0.112
σ0.103-0.144=-0.042
min2.555-2.557=-0.002
max2.785-2.929=-0.144
iters=5
new-facts=6402
prior-facts=1
mean4808.739-4808.744=-0.005
σ7.665-7.673=-0.007
min4805.251-4805.262=-0.011
max4822.451-4822.469=-0.018
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean8.682-8.950=-0.268
σ0.517-0.130=0.387
min7.778-8.807=-1.029
max9.022-9.104=-0.082
iters=5
new-facts=6402
prior-facts=6402
mean4996.341-4996.351=-0.010
σ0.017-0.023=-0.006
min4996.313-4996.327=-0.014
max4996.355-4996.376=-0.021
mean3065.200-3047.400=17.800
σ303.369-230.004=73.365
min2840.000-2828.000=12.000
max3531.000-3286.000=245.000
mean8.512-8.645=-0.133
σ0.130-0.113=0.017
min8.401-8.490=-0.089
max8.733-8.785=-0.052

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.000=-0.028
σ0.064-0.065=-0.001
min0.916-0.920=-0.004
max1.045-1.054=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.970-462.976=-0.006
σ574.256-574.253=0.003
min175.836-175.838=-0.002
max1324.355-1324.355=-0.001
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean0.430-0.432=-0.002
σ0.294-0.298=-0.004
min0.281-0.279=0.002
max0.871-0.879=-0.009
policies=20
mean1758.692-1758.730=-0.038
σ0.354-0.347=0.007
min1758.446-1758.477=-0.030
max1759.216-1759.242=-0.027
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean2.795-2.811=-0.017
σ0.010-0.036=-0.026
min2.786-2.778=0.008
max2.809-2.851=-0.042
policies=200
mean17593.348-17593.147=0.200
σ0.618-0.637=-0.019
min17592.499-17592.229=0.270
max17593.859-17593.588=0.270
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2828.000=12.000
σ0.000
min2840.000-2828.000=12.000
max2840.000-2828.000=12.000
mean27.885-27.885=0.000
σ0.315-0.353=-0.038
min27.576-27.552=0.024
max28.236-28.266=-0.030