Compare commits

Home / Compare 4e4c32c6 .. 11d33ee9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.431-54.430=0.000
σ0.050-0.050=0.000
min54.392-54.393=-0.001
max54.569-54.567=0.002
mean418.000-413.700=4.300
σ0.000-0.483=-0.483
min418.000-413.000=5.000
max418.000-414.000=4.000
mean0.135-0.137=-0.002
σ0.006-0.004=0.002
min0.128-0.133=-0.005
max0.147-0.142=0.005
cache=y
dps=1
iters=10
policies=100
mean43.762-43.761=0.001
σ0.004-0.004=0.000
min43.755-43.756=-0.001
max43.770-43.767=0.002
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.114-0.117=-0.002
σ0.003-0.003=0.000
min0.110-0.112=-0.002
max0.122-0.124=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1764.852-1764.851=0.001
σ0.365-0.366=-0.001
min1764.272-1764.272=-0.000
max1765.430-1765.438=-0.008
mean1636.050-1655.450=-19.400
σ622.371-636.674=-14.302
min628.000-622.000=6.000
max2764.000-2794.000=-30.000
mean2.656-2.600=0.057
σ0.321-0.292=0.029
min2.301-2.268=0.033
max3.449-3.073=0.377

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean345.188-345.195=-0.006
σ0.066-0.069=-0.003
min345.071-345.071=-0.000
max345.226-345.238=-0.012
mean2764.000-2794.000=-30.000
σ0.000
min2764.000-2794.000=-30.000
max2764.000-2794.000=-30.000
mean0.447-0.451=-0.003
σ0.006-0.008=-0.002
min0.443-0.444=-0.001
max0.457-0.461=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2007.370-2007.368=0.002
σ0.010-0.009=0.001
min2007.357-2007.354=0.002
max2007.382-2007.377=0.005
mean2764.000-2794.000=-30.000
σ0.000
min2764.000-2794.000=-30.000
max2764.000-2794.000=-30.000
mean2.737-2.807=-0.070
σ0.162-0.167=-0.005
min2.612-2.674=-0.061
max2.956-3.090=-0.135
iters=5
new-facts=6402
prior-facts=1
mean4832.270-4832.056=0.214
σ7.742-7.872=-0.131
min4828.664-4827.825=0.839
max4846.118-4846.118=-0.000
mean2764.000-2794.000=-30.000
σ0.000
min2764.000-2794.000=-30.000
max2764.000-2794.000=-30.000
mean8.585-8.464=0.122
σ0.658-0.743=-0.086
min7.677-7.731=-0.055
max9.301-9.303=-0.001
iters=5
new-facts=6402
prior-facts=6402
mean5019.699-5019.764=-0.065
σ0.151-0.018=0.132
min5019.431-5019.743=-0.311
max5019.788-5019.786=0.002
mean3009.600-3030.000=-20.400
σ234.295-306.118=-71.823
min2764.000-2794.000=-30.000
max3318.000-3505.000=-187.000
mean9.874-9.624=0.251
σ0.152-0.207=-0.054
min9.700-9.371=0.329
max10.077-9.868=0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.002=0.022
σ0.177-0.140=0.036
min0.918-0.908=0.010
max1.330-1.231=0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.719-466.711=0.009
σ574.778-574.761=0.017
min179.313-179.319=-0.007
max1328.886-1328.852=0.034
mean90.250
σ8.500
min86.000
max103.000
mean2764.000-2794.000=-30.000
σ0.000
min2764.000-2794.000=-30.000
max2764.000-2794.000=-30.000
mean0.591-0.435=0.157
σ0.501-0.308=0.192
min0.285-0.280=0.005
max1.333-0.897=0.436
policies=20
mean1793.486-1793.516=-0.030
σ0.322-0.376=-0.054
min1793.221-1793.243=-0.021
max1793.954-1794.068=-0.113
mean860.000
σ0.000
min860.000
max860.000
mean2764.000-2794.000=-30.000
σ0.000
min2764.000-2794.000=-30.000
max2764.000-2794.000=-30.000
mean2.752-2.840=-0.087
σ0.021-0.014=0.007
min2.726-2.826=-0.100
max2.770-2.857=-0.087
policies=200
mean17942.146-17942.082=0.064
σ0.528-0.444=0.085
min17941.858-17941.689=0.168
max17942.937-17942.719=0.218
mean8600.000
σ0.000
min8600.000
max8600.000
mean2764.000-2794.000=-30.000
σ0.000
min2764.000-2794.000=-30.000
max2764.000-2794.000=-30.000
mean27.755-28.080=-0.325
σ0.143-0.269=-0.126
min27.623-27.830=-0.207
max27.900-28.322=-0.422