Compare commits

Home / Compare bd762587 .. f6b8f10c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.376=-0.003
σ0.059-0.058=0.002
min70.331-70.340=-0.009
max70.538-70.538=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.157-0.163=-0.006
σ0.004-0.003=0.001
min0.152-0.157=-0.005
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.002
σ0.001-0.002=-0.001
min21.143-21.140=0.003
max21.146-21.147=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.063=0.002
σ0.002-0.003=-0.001
min0.062-0.059=0.003
max0.069-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.201=-0.002
σ0.363-0.362=0.000
min1751.632-1751.627=0.005
max1752.786-1752.786=0.000
mean1650.650-1654.050=-3.400
σ623.661-642.594=-18.934
min689.000-622.000=67.000
max2804.000-2774.000=30.000
mean2.828-2.869=-0.040
σ0.110-0.116=-0.007
min2.554-2.598=-0.044
max2.991-3.139=-0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.931=0.000
σ0.008-0.006=0.002
min269.920-269.924=-0.004
max269.941-269.940=0.002
mean2804.000-2774.000=30.000
σ0.000
min2804.000-2774.000=30.000
max2804.000-2774.000=30.000
mean0.371-0.374=-0.003
σ0.007-0.007=0.000
min0.365-0.368=-0.003
max0.384-0.386=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.388-1930.397=-0.009
σ0.019-0.016=0.003
min1930.364-1930.372=-0.008
max1930.408-1930.411=-0.003
mean2804.000-2774.000=30.000
σ0.000
min2804.000-2774.000=30.000
max2804.000-2774.000=30.000
mean2.523-2.534=-0.012
σ0.144-0.109=0.036
min2.402-2.416=-0.014
max2.766-2.710=0.056
iters=5
new-facts=6402
prior-facts=1
mean4750.915-4750.816=0.099
σ0.783-0.839=-0.056
min4750.476-4750.156=0.320
max4752.305-4752.283=0.022
mean2804.000-2774.000=30.000
σ0.000
min2804.000-2774.000=30.000
max2804.000-2774.000=30.000
mean8.194-8.150=0.044
σ0.310-0.314=-0.004
min7.866-7.836=0.030
max8.574-8.529=0.045
iters=5
new-facts=6402
prior-facts=6402
mean4941.114-4941.329=-0.214
σ0.363-0.078=0.285
min4940.562-4941.254=-0.692
max4941.405-4941.413=-0.009
mean3059.400-3053.400=6.000
σ319.305-340.142=-20.836
min2804.000-2774.000=30.000
max3541.000-3565.000=-24.000
mean8.393-8.441=-0.049
σ0.030-0.152=-0.121
min8.342-8.247=0.095
max8.423-8.650=-0.227

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.085-1.080=0.006
σ0.113-0.110=0.003
min0.943-0.941=0.002
max1.260-1.249=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.941-465.942=-0.000
σ575.830-575.821=0.009
min178.023-178.017=0.006
max1329.686-1329.672=0.014
mean81.750
σ7.500
min78.000
max93.000
mean2804.000-2774.000=30.000
σ0.000
min2804.000-2774.000=30.000
max2804.000-2774.000=30.000
mean0.442-0.484=-0.042
σ0.308-0.383=-0.075
min0.285-0.290=-0.005
max0.904-1.058=-0.154
policies=20
mean1780.476-1780.469=0.007
σ0.338-0.346=-0.008
min1780.222-1780.206=0.015
max1780.967-1780.974=-0.007
mean780.000
σ0.000
min780.000
max780.000
mean2804.000-2774.000=30.000
σ0.000
min2804.000-2774.000=30.000
max2804.000-2774.000=30.000
mean2.867-2.855=0.012
σ0.098-0.119=-0.020
min2.766-2.761=0.005
max3.002-3.018=-0.016
policies=200
mean17811.357-17811.291=0.066
σ0.526-0.514=0.012
min17810.930-17810.886=0.044
max17812.124-17812.035=0.090
mean7800.000
σ0.000
min7800.000
max7800.000
mean2804.000-2774.000=30.000
σ0.000
min2804.000-2774.000=30.000
max2804.000-2774.000=30.000
mean27.831-27.903=-0.073
σ0.104-0.106=-0.002
min27.757-27.813=-0.056
max27.980-28.035=-0.055