Compare commits

Home / Compare b9bdf875 .. 620a824f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.389=0.001
σ0.047-0.046=0.001
min70.365-70.361=0.004
max70.522-70.518=0.004
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.161-0.159=0.002
σ0.003-0.003=-0.001
min0.158-0.157=0.001
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.001-0.002=-0.000
min21.142-21.143=-0.001
max21.146-21.149=-0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.064=-0.000
σ0.003-0.003=-0.001
min0.062-0.059=0.003
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.002
σ0.359-0.361=-0.002
min1751.823-1751.820=0.003
max1752.956-1752.980=-0.023
mean1630.450-1654.400=-23.950
σ589.866-645.809=-55.943
min628.000-631.000=-3.000
max2418.000-2850.000=-432.000
mean2.780-2.827=-0.047
σ0.209-0.179=0.030
min2.279-2.134=0.145
max3.016-2.986=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.145=-0.005
σ0.006-0.008=-0.002
min270.132-270.136=-0.004
max270.148-270.153=-0.005
mean2418.000-2850.000=-432.000
σ0.000
min2418.000-2850.000=-432.000
max2418.000-2850.000=-432.000
mean0.378-0.380=-0.002
σ0.005-0.006=-0.001
min0.370-0.371=-0.001
max0.384-0.388=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.605-1930.608=-0.003
σ0.008-0.010=-0.002
min1930.596-1930.594=0.002
max1930.618-1930.620=-0.002
mean2418.000-2850.000=-432.000
σ0.000
min2418.000-2850.000=-432.000
max2418.000-2850.000=-432.000
mean2.509-2.550=-0.041
σ0.056-0.147=-0.092
min2.454-2.437=0.017
max2.578-2.783=-0.205
iters=5
new-facts=6402
prior-facts=1
mean4751.236-4751.316=-0.080
σ0.968-0.852=0.116
min4750.510-4750.824=-0.314
max4752.929-4752.830=0.099
mean2418.000-2850.000=-432.000
σ0.000
min2418.000-2850.000=-432.000
max2418.000-2850.000=-432.000
mean8.379-8.500=-0.121
σ0.538-0.400=0.138
min7.666-7.893=-0.227
max9.042-9.016=0.026
iters=5
new-facts=6402
prior-facts=6402
mean4941.702-4941.771=-0.070
σ0.143-0.019=0.125
min4941.446-4941.750=-0.304
max4941.776-4941.794=-0.018
mean2984.800-3057.800=-73.000
σ284.178-193.984=90.194
min2602.000-2850.000=-248.000
max3324.000-3336.000=-12.000
mean8.501-8.557=-0.056
σ0.218-0.223=-0.005
min8.200-8.374=-0.174
max8.740-8.901=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.839-0.997=0.843
σ0.073-0.154=-0.081
min1.750-0.925=0.825
max1.949-1.272=0.677

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.367-466.381=-0.014
σ575.931-575.941=-0.010
min178.399-178.397=0.002
max1330.263-1330.293=-0.029
mean84.250
σ8.500
min80.000
max97.000
mean2418.000-2850.000=-432.000
σ0.000
min2418.000-2850.000=-432.000
max2418.000-2850.000=-432.000
mean0.568-0.527=0.041
σ0.573-0.476=0.097
min0.279-0.284=-0.005
max1.427-1.242=0.186
policies=20
mean1784.309-1784.359=-0.050
σ0.352-0.369=-0.017
min1784.084-1784.101=-0.017
max1784.833-1784.903=-0.070
mean800.000
σ0.000
min800.000
max800.000
mean2418.000-2850.000=-432.000
σ0.000
min2418.000-2850.000=-432.000
max2418.000-2850.000=-432.000
mean2.774-2.862=-0.088
σ0.022-0.017=0.005
min2.753-2.849=-0.096
max2.796-2.887=-0.091
policies=200
mean17849.728-17849.946=-0.217
σ0.432-0.366=0.067
min17849.472-17849.680=-0.208
max17850.375-17850.483=-0.108
mean8000.000
σ0.000
min8000.000
max8000.000
mean2418.000-2850.000=-432.000
σ0.000
min2418.000-2850.000=-432.000
max2418.000-2850.000=-432.000
mean28.009-28.515=-0.506
σ0.229-0.647=-0.418
min27.764-27.874=-0.109
max28.248-29.080=-0.832