Compare commits

Home / Compare b83ae114 .. caa14e4c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.380=-0.001
σ0.045-0.048=-0.003
min70.351-70.351=0.000
max70.503-70.514=-0.011
mean414.200-413.000=1.200
σ0.422-0.000=0.422
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.162-0.157=0.005
σ0.003-0.005=-0.003
min0.159-0.149=0.010
max0.167-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.002=0.001
min21.138-21.142=-0.004
max21.147-21.149=-0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.064=-0.001
σ0.003-0.002=0.001
min0.060-0.063=-0.003
max0.071-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.388=-0.002
σ0.360-0.360=-0.001
min1751.818-1751.820=-0.002
max1752.951-1752.973=-0.023
mean1642.150-1633.150=9.000
σ613.929-597.141=16.787
min671.000-624.000=47.000
max2545.000-2412.000=133.000
mean2.785-2.811=-0.027
σ0.169-0.191=-0.022
min2.440-2.193=0.248
max3.136-3.031=0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.130=-0.004
σ0.006-0.007=-0.001
min270.120-270.122=-0.002
max270.133-270.139=-0.006
mean2545.000-2412.000=133.000
σ0.000
min2545.000-2412.000=133.000
max2545.000-2412.000=133.000
mean0.374-0.379=-0.005
σ0.004-0.001=0.002
min0.371-0.377=-0.006
max0.381-0.381=0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.590=0.004
σ0.009-0.016=-0.007
min1930.583-1930.562=0.021
max1930.604-1930.603=0.001
mean2545.000-2412.000=133.000
σ0.000
min2545.000-2412.000=133.000
max2545.000-2412.000=133.000
mean2.503-2.509=-0.006
σ0.041-0.066=-0.025
min2.471-2.439=0.032
max2.569-2.608=-0.039
iters=5
new-facts=6402
prior-facts=1
mean4751.012-4751.095=-0.083
σ0.538-0.858=-0.320
min4750.751-4750.643=0.108
max4751.973-4752.626=-0.653
mean2545.000-2412.000=133.000
σ0.000
min2545.000-2412.000=133.000
max2545.000-2412.000=133.000
mean8.181-8.282=-0.102
σ0.430-0.682=-0.252
min7.666-7.673=-0.006
max8.604-9.080=-0.476
iters=5
new-facts=6402
prior-facts=6402
mean4941.320-4941.523=-0.203
σ0.287-0.079=0.208
min4940.924-4941.458=-0.534
max4941.636-4941.611=0.025
mean2984.400-2939.800=44.600
σ284.461-424.374=-139.913
min2600.000-2468.000=132.000
max3322.000-3511.000=-189.000
mean8.580-8.415=0.165
σ0.219-0.143=0.076
min8.429-8.252=0.177
max8.923-8.646=0.277

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.444-1.861=-0.418
σ0.271-0.146=0.126
min1.196-1.647=-0.451
max1.802-2.004=-0.202

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.357-466.352=0.005
σ575.931-575.917=0.014
min178.390-178.392=-0.001
max1330.254-1330.228=0.027
mean84.000
σ8.000
min80.000
max96.000
mean2545.000-2412.000=133.000
σ0.000
min2545.000-2412.000=133.000
max2545.000-2412.000=133.000
mean0.567-0.560=0.006
σ0.569-0.560=0.009
min0.278-0.277=0.001
max1.420-1.401=0.019
policies=20
mean1784.206-1784.222=-0.016
σ0.359-0.356=0.003
min1783.980-1783.998=-0.018
max1784.740-1784.752=-0.012
mean800.000
σ0.000
min800.000
max800.000
mean2545.000-2412.000=133.000
σ0.000
min2545.000-2412.000=133.000
max2545.000-2412.000=133.000
mean2.792-2.779=0.013
σ0.006-0.014=-0.008
min2.784-2.769=0.016
max2.798-2.799=-0.001
policies=200
mean17848.874-17848.884=-0.011
σ0.516-0.497=0.020
min17848.533-17848.575=-0.042
max17849.643-17849.626=0.016
mean8000.000
σ0.000
min8000.000
max8000.000
mean2545.000-2412.000=133.000
σ0.000
min2545.000-2412.000=133.000
max2545.000-2412.000=133.000
mean28.020-27.845=0.174
σ0.089-0.038=0.051
min27.942-27.807=0.135
max28.132-27.897=0.235