Compare commits

Home / Compare 64b9767f .. 24dedab0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.389=0.001
σ0.046-0.044=0.002
min70.360-70.363=-0.004
max70.517-70.511=0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.161-0.159=0.002
σ0.003-0.005=-0.002
min0.157-0.151=0.006
max0.166-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.002=0.001
min21.140-21.141=-0.000
max21.150-21.148=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.065=-0.003
σ0.003-0.002=0.002
min0.058-0.064=-0.005
max0.069-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.395=-0.001
σ0.361-0.360=0.002
min1751.821-1751.827=-0.006
max1752.982-1752.971=0.011
mean1662.100-1661.150=0.950
σ629.883-638.749=-8.865
min677.000-621.000=56.000
max2663.000-2815.000=-152.000
mean2.852-2.870=-0.018
σ0.091-0.118=-0.027
min2.711-2.512=0.199
max3.045-3.053=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.236-270.237=-0.001
σ0.006-0.008=-0.002
min270.226-270.227=-0.001
max270.242-270.249=-0.007
mean2663.000-2815.000=-152.000
σ0.000
min2663.000-2815.000=-152.000
max2663.000-2815.000=-152.000
mean0.380-0.379=0.000
σ0.004-0.007=-0.003
min0.375-0.372=0.003
max0.386-0.386=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.698-1930.689=0.010
σ0.010-0.021=-0.012
min1930.689-1930.662=0.027
max1930.709-1930.707=0.002
mean2663.000-2815.000=-152.000
σ0.000
min2663.000-2815.000=-152.000
max2663.000-2815.000=-152.000
mean2.568-2.512=0.056
σ0.110-0.198=-0.088
min2.474-2.303=0.172
max2.718-2.839=-0.120
iters=5
new-facts=6402
prior-facts=1
mean4751.158-4751.340=-0.182
σ1.162-0.923=0.239
min4749.782-4750.515=-0.733
max4753.001-4752.900=0.101
mean2663.000-2815.000=-152.000
σ0.000
min2663.000-2815.000=-152.000
max2663.000-2815.000=-152.000
mean8.580-8.321=0.259
σ0.542-0.669=-0.127
min7.794-7.680=0.115
max9.004-9.400=-0.396
iters=5
new-facts=6402
prior-facts=6402
mean4941.866-4941.801=0.066
σ0.017-0.146=-0.130
min4941.843-4941.540=0.303
max4941.883-4941.875=0.009
mean3026.600-3005.800=20.800
σ300.548-206.124=94.423
min2663.000-2815.000=-152.000
max3425.000-3313.000=112.000
mean8.524-8.634=-0.110
σ0.112-0.147=-0.035
min8.400-8.510=-0.110
max8.662-8.870=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.172-1.057=0.115
σ0.241-0.130=0.112
min0.934-0.940=-0.006
max1.555-1.257=0.298

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.374-466.373=0.000
σ575.939-575.936=0.003
min178.401-178.401=-0.001
max1330.282-1330.277=0.005
mean84.250
σ8.500
min80.000
max97.000
mean2663.000-2815.000=-152.000
σ0.000
min2663.000-2815.000=-152.000
max2663.000-2815.000=-152.000
mean0.562-0.445=0.117
σ0.570-0.305=0.265
min0.271-0.285=-0.014
max1.416-0.902=0.514
policies=20
mean1784.330-1784.370=-0.040
σ0.362-0.341=0.022
min1784.105-1784.128=-0.023
max1784.870-1784.866=0.004
mean800.000
σ0.000
min800.000
max800.000
mean2663.000-2815.000=-152.000
σ0.000
min2663.000-2815.000=-152.000
max2663.000-2815.000=-152.000
mean2.790-2.886=-0.096
σ0.014-0.113=-0.099
min2.775-2.777=-0.002
max2.807-3.044=-0.237
policies=200
mean17849.781-17849.718=0.062
σ0.507-0.522=-0.015
min17849.437-17849.374=0.063
max17850.516-17850.490=0.026
mean8000.000
σ0.000
min8000.000
max8000.000
mean2663.000-2815.000=-152.000
σ0.000
min2663.000-2815.000=-152.000
max2663.000-2815.000=-152.000
mean28.116-27.962=0.154
σ0.186-0.018=0.168
min27.912-27.947=-0.035
max28.308-27.985=0.323