Compare commits

Home / Compare 3bf24fef .. 8e7f5d6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.390=-0.001
σ0.049-0.048=0.001
min70.357-70.359=-0.002
max70.525-70.523=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.158-0.158=0.000
σ0.006-0.003=0.003
min0.149-0.154=-0.005
max0.167-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.003-0.004=-0.001
min21.142-21.137=0.004
max21.149-21.150=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.000
min0.062-0.060=0.002
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.392-1752.395=-0.003
σ0.361-0.362=-0.002
min1751.826-1751.821=0.005
max1752.977-1752.984=-0.007
mean1660.250-1659.800=0.450
σ634.494-633.236=1.258
min617.000-618.000=-1.000
max2775.000-2771.000=4.000
mean2.779-2.798=-0.018
σ0.161-0.183=-0.022
min2.235-2.269=-0.034
max2.977-3.173=-0.196

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.236-270.235=0.002
σ0.011-0.007=0.004
min270.221-270.226=-0.005
max270.250-270.245=0.006
mean2775.000-2771.000=4.000
σ0.000
min2775.000-2771.000=4.000
max2775.000-2771.000=4.000
mean0.375-0.376=-0.001
σ0.004-0.003=0.001
min0.368-0.370=-0.002
max0.378-0.379=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.704-1930.702=0.003
σ0.011-0.017=-0.006
min1930.692-1930.672=0.020
max1930.717-1930.711=0.006
mean2775.000-2771.000=4.000
σ0.000
min2775.000-2771.000=4.000
max2775.000-2771.000=4.000
mean2.504-2.518=-0.014
σ0.120-0.082=0.038
min2.382-2.395=-0.013
max2.681-2.602=0.079
iters=5
new-facts=6402
prior-facts=1
mean4751.210-4751.440=-0.230
σ0.733-0.880=-0.147
min4750.618-4750.945=-0.327
max4752.484-4753.008=-0.523
mean2775.000-2771.000=4.000
σ0.000
min2775.000-2771.000=4.000
max2775.000-2771.000=4.000
mean8.529-8.263=0.266
σ0.381-0.459=-0.078
min7.988-7.648=0.340
max9.052-8.772=0.280
iters=5
new-facts=6402
prior-facts=6402
mean4941.796-4941.726=0.071
σ0.158-0.213=-0.055
min4941.516-4941.493=0.023
max4941.892-4941.896=-0.003
mean3021.400-3032.600=-11.200
σ237.904-317.952=-80.048
min2775.000-2771.000=4.000
max3337.000-3512.000=-175.000
mean8.575-8.392=0.183
σ0.238-0.094=0.144
min8.351-8.315=0.036
max8.860-8.556=0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.050=-0.038
σ0.136-0.133=0.002
min0.913-0.930=-0.017
max1.233-1.258=-0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.376-466.377=-0.002
σ575.927-575.927=0.000
min178.405-178.411=-0.006
max1330.266-1330.268=-0.001
mean84.250
σ8.500
min80.000
max97.000
mean2775.000-2771.000=4.000
σ0.000
min2775.000-2771.000=4.000
max2775.000-2771.000=4.000
mean0.431-0.443=-0.012
σ0.310-0.304=0.006
min0.255-0.290=-0.035
max0.896-0.899=-0.003
policies=20
mean1784.351-1784.367=-0.016
σ0.337-0.369=-0.033
min1784.100-1784.128=-0.028
max1784.848-1784.914=-0.067
mean800.000
σ0.000
min800.000
max800.000
mean2775.000-2771.000=4.000
σ0.000
min2775.000-2771.000=4.000
max2775.000-2771.000=4.000
mean2.843-2.836=0.006
σ0.104-0.080=0.024
min2.763-2.762=0.001
max2.986-2.941=0.045
policies=200
mean17849.856-17849.748=0.108
σ0.507-0.582=-0.075
min17849.488-17849.439=0.049
max17850.607-17850.620=-0.014
mean8000.000
σ0.000
min8000.000
max8000.000
mean2775.000-2771.000=4.000
σ0.000
min2775.000-2771.000=4.000
max2775.000-2771.000=4.000
mean27.914-28.035=-0.121
σ0.132-0.205=-0.074
min27.818-27.860=-0.042
max28.109-28.303=-0.195