Compare commits

Home / Compare 58e81a67 .. b299aeec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.429-54.430=-0.002
σ0.049-0.050=-0.001
min54.380-54.394=-0.015
max54.560-54.568=-0.008
mean418.400-414.000=4.400
σ0.966-0.000=0.966
min417.000-414.000=3.000
max419.000-414.000=5.000
mean0.135-0.137=-0.001
σ0.004-0.003=0.001
min0.130-0.134=-0.003
max0.141-0.140=0.001
cache=y
dps=1
iters=10
policies=100
mean43.760-43.760=0.000
σ0.006-0.003=0.003
min43.750-43.756=-0.006
max43.767-43.766=0.002
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.117-0.118=-0.001
σ0.003-0.004=-0.001
min0.114-0.114=-0.000
max0.122-0.126=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.851-1764.851=-0.000
σ0.367-0.365=0.002
min1764.271-1764.274=-0.003
max1765.441-1765.432=0.009
mean1641.700-1657.950=-16.250
σ604.637-638.232=-33.594
min661.000-622.000=39.000
max2451.000-2766.000=-315.000
mean2.599-2.629=-0.030
σ0.268-0.288=-0.019
min2.321-2.291=0.030
max3.094-3.261=-0.167

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean345.196-337.088=8.108
σ0.072-18.105=-18.033
min345.069-304.702=40.367
max345.239-345.233=0.006
mean2451.000-2766.000=-315.000
σ0.000
min2451.000-2766.000=-315.000
max2451.000-2766.000=-315.000
mean0.449-0.436=0.013
σ0.008-0.028=-0.021
min0.443-0.386=0.058
max0.463-0.455=0.007
iters=5
new-facts=1
prior-facts=6402
mean2007.362-2007.367=-0.006
σ0.013-0.011=0.002
min2007.343-2007.350=-0.007
max2007.375-2007.378=-0.003
mean2451.000-2766.000=-315.000
σ0.000
min2451.000-2766.000=-315.000
max2451.000-2766.000=-315.000
mean2.766-2.778=-0.012
σ0.240-0.133=0.108
min2.553-2.683=-0.130
max3.160-3.010=0.151
iters=5
new-facts=6402
prior-facts=1
mean4832.033-4832.148=-0.115
σ7.847-7.809=0.039
min4828.115-4828.173=-0.057
max4846.061-4846.107=-0.046
mean2451.000-2766.000=-315.000
σ0.000
min2451.000-2766.000=-315.000
max2451.000-2766.000=-315.000
mean8.339-8.687=-0.348
σ0.628-0.687=-0.059
min7.784-7.762=0.022
max9.187-9.334=-0.148
iters=5
new-facts=6402
prior-facts=6402
mean5019.770-5019.703=0.067
σ0.018-0.162=-0.143
min5019.745-5019.416=0.329
max5019.791-5019.791=-0.001
mean2951.000-2992.200=-41.200
σ442.078-222.365=219.713
min2460.000-2766.000=-306.000
max3546.000-3314.000=232.000
mean9.401-9.805=-0.404
σ0.594-0.165=0.429
min8.497-9.578=-1.081
max10.107-10.038=0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.777-1.026=0.751
σ0.085-0.126=-0.041
min1.628-0.912=0.716
max1.836-1.222=0.614

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.699-466.710=-0.011
σ574.757-574.760=-0.002
min179.318-179.317=0.001
max1328.834-1328.849=-0.015
mean90.250
σ8.500
min86.000
max103.000
mean2451.000-2766.000=-315.000
σ0.000
min2451.000-2766.000=-315.000
max2451.000-2766.000=-315.000
mean0.553-0.438=0.114
σ0.548-0.308=0.240
min0.277-0.282=-0.005
max1.375-0.900=0.475
policies=20
mean1793.464-1793.485=-0.021
σ0.390-0.374=0.016
min1793.206-1793.212=-0.005
max1794.042-1794.033=0.009
mean860.000
σ0.000
min860.000
max860.000
mean2451.000-2766.000=-315.000
σ0.000
min2451.000-2766.000=-315.000
max2451.000-2766.000=-315.000
mean2.747-2.834=-0.087
σ0.010-0.006=0.004
min2.740-2.828=-0.089
max2.762-2.841=-0.079
policies=200
mean17942.126-17942.093=0.033
σ0.395-0.509=-0.114
min17941.841-17941.777=0.064
max17942.711-17942.852=-0.141
mean8600.000
σ0.000
min8600.000
max8600.000
mean2451.000-2766.000=-315.000
σ0.000
min2451.000-2766.000=-315.000
max2451.000-2766.000=-315.000
mean27.780-27.863=-0.082
σ0.080-0.252=-0.172
min27.673-27.585=0.087
max27.859-28.137=-0.278