Compare commits

Home / Compare bd370bd7 .. b7063bc4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.245=0.018
σ0.054-0.055=-0.000
min35.230-35.218=0.012
max35.415-35.398=0.016
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.085-0.085=0.000
σ0.003-0.003=0.000
min0.082-0.083=-0.000
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=-0.000
min23.765-23.765=-0.000
max23.776-23.775=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.067-0.069=-0.003
σ0.005-0.004=0.001
min0.062-0.066=-0.004
max0.075-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.484=0.002
σ0.365-0.365=-0.000
min1755.911-1755.910=0.001
max1757.074-1757.081=-0.007
mean1650.150-1648.250=1.900
σ641.911-640.509=1.401
min626.000-625.000=1.000
max2827.000-2830.000=-3.000
mean2.353-2.358=-0.005
σ0.101-0.119=-0.018
min2.257-2.264=-0.007
max2.718-2.794=-0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.713-324.700=0.013
σ0.040-0.063=-0.022
min324.642-324.589=0.053
max324.744-324.738=0.007
mean2827.000-2830.000=-3.000
σ0.000
min2827.000-2830.000=-3.000
max2827.000-2830.000=-3.000
mean0.427-0.437=-0.010
σ0.003-0.010=-0.007
min0.425-0.424=0.001
max0.430-0.450=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1985.257-1985.262=-0.006
σ0.020-0.011=0.009
min1985.234-1985.244=-0.010
max1985.283-1985.273=0.010
mean2827.000-2830.000=-3.000
σ0.000
min2827.000-2830.000=-3.000
max2827.000-2830.000=-3.000
mean2.629-2.681=-0.052
σ0.126-0.137=-0.011
min2.533-2.551=-0.019
max2.830-2.882=-0.052
iters=5
new-facts=6402
prior-facts=1
mean4808.771-4808.780=-0.008
σ7.782-7.754=0.028
min4804.803-4805.067=-0.264
max4822.682-4822.648=0.034
mean2827.000-2830.000=-3.000
σ0.000
min2827.000-2830.000=-3.000
max2827.000-2830.000=-3.000
mean8.877-8.568=0.308
σ0.410-0.662=-0.252
min8.312-7.766=0.545
max9.403-9.099=0.304
iters=5
new-facts=6402
prior-facts=6402
mean4996.256-4996.454=-0.198
σ0.195-0.024=0.171
min4996.101-4996.423=-0.322
max4996.488-4996.477=0.012
mean3063.600-3060.400=3.200
σ308.514-304.147=4.367
min2827.000-2830.000=-3.000
max3536.000-3531.000=5.000
mean8.468-8.572=-0.104
σ0.115-0.151=-0.036
min8.288-8.448=-0.160
max8.603-8.784=-0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.934-1.037=-0.103
σ0.068-0.162=-0.094
min0.892-0.915=-0.023
max1.050-1.217=-0.167

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.970-462.975=-0.005
σ574.247-574.253=-0.006
min175.840-175.839=0.002
max1324.340-1324.355=-0.015
mean86.250
σ8.500
min82.000
max99.000
mean2827.000-2830.000=-3.000
σ0.000
min2827.000-2830.000=-3.000
max2827.000-2830.000=-3.000
mean0.426-0.474=-0.048
σ0.307-0.378=-0.071
min0.247-0.281=-0.034
max0.887-1.041=-0.155
policies=20
mean1758.707-1758.714=-0.007
σ0.291-0.345=-0.054
min1758.494-1758.478=0.017
max1759.136-1759.225=-0.088
mean820.000
σ0.000
min820.000
max820.000
mean2827.000-2830.000=-3.000
σ0.000
min2827.000-2830.000=-3.000
max2827.000-2830.000=-3.000
mean2.652-2.801=-0.149
σ0.274-0.003=0.271
min2.241-2.797=-0.556
max2.797-2.805=-0.008
policies=200
mean17593.372-17593.173=0.199
σ0.738-0.618=0.120
min17592.371-17592.283=0.087
max17593.945-17593.596=0.349
mean8200.000
σ0.000
min8200.000
max8200.000
mean2827.000-2830.000=-3.000
σ0.000
min2827.000-2830.000=-3.000
max2827.000-2830.000=-3.000
mean27.881-27.980=-0.099
σ0.397-0.362=0.035
min27.530-27.612=-0.082
max28.351-28.365=-0.014