Compare commits

Home / Compare 9bd63548 .. 2bd65c0f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.394-70.396=-0.002
σ0.047-0.044=0.002
min70.363-70.367=-0.003
max70.524-70.518=0.005
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.155-0.160=-0.006
σ0.006-0.003=0.002
min0.147-0.157=-0.010
max0.162-0.165=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.147-21.147=-0.000
σ0.003-0.003=-0.000
min21.142-21.141=0.001
max21.152-21.154=-0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.061-0.064=-0.003
σ0.003-0.004=-0.001
min0.057-0.059=-0.002
max0.067-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.393=0.002
σ0.363-0.362=0.000
min1751.823-1751.829=-0.006
max1752.978-1752.960=0.018
mean1650.750-1656.200=-5.450
σ626.083-644.704=-18.621
min626.000-622.000=4.000
max2849.000-2850.000=-1.000
mean2.811-2.857=-0.046
σ0.161-0.194=-0.033
min2.266-2.281=-0.015
max3.046-3.187=-0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.119=0.010
σ0.009-0.004=0.005
min270.120-270.114=0.005
max270.142-270.124=0.018
mean2849.000-2850.000=-1.000
σ0.000
min2849.000-2850.000=-1.000
max2849.000-2850.000=-1.000
mean0.380-0.380=0.000
σ0.006-0.001=0.005
min0.372-0.378=-0.006
max0.389-0.381=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.604-1930.566=0.038
σ0.015-0.064=-0.049
min1930.581-1930.455=0.126
max1930.619-1930.613=0.006
mean2849.000-2850.000=-1.000
σ0.000
min2849.000-2850.000=-1.000
max2849.000-2850.000=-1.000
mean2.517-2.590=-0.073
σ0.075-0.128=-0.053
min2.478-2.477=0.001
max2.652-2.788=-0.136
iters=5
new-facts=6402
prior-facts=1
mean4750.811-4751.185=-0.375
σ1.303-1.033=0.270
min4749.619-4750.208=-0.589
max4752.855-4752.943=-0.087
mean2849.000-2850.000=-1.000
σ0.000
min2849.000-2850.000=-1.000
max2849.000-2850.000=-1.000
mean8.971-8.701=0.270
σ0.285-0.559=-0.273
min8.561-7.968=0.593
max9.231-9.424=-0.193
iters=5
new-facts=6402
prior-facts=6402
mean4941.765-4941.694=0.070
σ0.013-0.170=-0.157
min4941.753-4941.391=0.362
max4941.780-4941.784=-0.004
mean3028.400-2987.400=41.000
σ199.484-216.504=-17.020
min2849.000-2850.000=-1.000
max3334.000-3345.000=-11.000
mean8.477-8.395=0.082
σ0.120-0.022=0.099
min8.347-8.365=-0.017
max8.652-8.417=0.235

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-1.103=-0.094
σ0.138-0.253=-0.115
min0.940-0.923=0.016
max1.256-1.500=-0.244

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.369-466.372=-0.003
σ575.920-575.929=-0.008
min178.397-178.405=-0.008
max1330.249-1330.265=-0.016
mean84.000
σ8.000
min80.000
max96.000
mean2849.000-2850.000=-1.000
σ0.000
min2849.000-2850.000=-1.000
max2849.000-2850.000=-1.000
mean0.442-0.446=-0.004
σ0.301-0.304=-0.004
min0.286-0.291=-0.005
max0.893-0.903=-0.010
policies=20
mean1784.344-1784.349=-0.005
σ0.346-0.367=-0.020
min1784.113-1784.095=0.018
max1784.856-1784.889=-0.032
mean800.000
σ0.000
min800.000
max800.000
mean2849.000-2850.000=-1.000
σ0.000
min2849.000-2850.000=-1.000
max2849.000-2850.000=-1.000
mean2.844-2.859=-0.015
σ0.048-0.007=0.041
min2.774-2.851=-0.077
max2.883-2.865=0.017
policies=200
mean17849.810-17849.775=0.035
σ0.431-0.418=0.013
min17849.523-17849.544=-0.021
max17850.452-17850.401=0.051
mean8000.000
σ0.000
min8000.000
max8000.000
mean2849.000-2850.000=-1.000
σ0.000
min2849.000-2850.000=-1.000
max2849.000-2850.000=-1.000
mean28.549-28.480=0.070
σ0.451-0.496=-0.044
min27.997-28.019=-0.021
max28.936-28.959=-0.023