Compare commits

Home / Compare 3967b760 .. cf8dc013

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.393-70.392=0.002
σ0.045-0.042=0.002
min70.371-70.369=0.001
max70.519-70.510=0.009
mean414.000-412.400=1.600
σ0.000-0.516=-0.516
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.159-0.159=-0.000
σ0.003-0.004=-0.001
min0.155-0.154=0.001
max0.163-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.003=-0.000
min21.139-21.140=-0.001
max21.148-21.148=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.064=-0.000
σ0.002-0.002=-0.000
min0.063-0.062=0.000
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.396=-0.002
σ0.360-0.362=-0.002
min1751.826-1751.823=0.003
max1752.960-1752.975=-0.015
mean1656.650-1633.700=22.950
σ629.902-608.772=21.130
min616.000-631.000=-15.000
max2772.000-2452.000=320.000
mean2.813-2.854=-0.041
σ0.150-0.114=0.036
min2.441-2.625=-0.184
max3.042-3.054=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.241-270.240=0.001
σ0.007-0.007=-0.000
min270.231-270.232=-0.000
max270.250-270.250=-0.000
mean2772.000-2452.000=320.000
σ0.000
min2772.000-2452.000=320.000
max2772.000-2452.000=320.000
mean0.386-0.383=0.003
σ0.011-0.008=0.003
min0.376-0.374=0.002
max0.401-0.395=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.704-1930.703=0.001
σ0.009-0.006=0.004
min1930.692-1930.697=-0.005
max1930.713-1930.712=0.001
mean2772.000-2452.000=320.000
σ0.000
min2772.000-2452.000=320.000
max2772.000-2452.000=320.000
mean2.511-2.526=-0.015
σ0.107-0.077=0.031
min2.387-2.430=-0.042
max2.665-2.621=0.044
iters=5
new-facts=6402
prior-facts=1
mean4751.444-4751.414=0.030
σ0.834-0.843=-0.009
min4750.847-4750.980=-0.133
max4752.910-4752.916=-0.006
mean2772.000-2452.000=320.000
σ0.000
min2772.000-2452.000=320.000
max2772.000-2452.000=320.000
mean8.202-8.460=-0.258
σ0.607-0.427=0.180
min7.797-7.743=0.054
max9.209-8.832=0.377
iters=5
new-facts=6402
prior-facts=6402
mean4941.866-4941.870=-0.003
σ0.032-0.018=0.013
min4941.828-4941.845=-0.017
max4941.898-4941.886=0.011
mean3043.800-3015.000=28.800
σ329.698-314.308=15.390
min2772.000-2599.000=173.000
max3535.000-3421.000=114.000
mean8.432-8.540=-0.107
σ0.148-0.080=0.068
min8.303-8.450=-0.147
max8.683-8.635=0.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.808=-0.808
σ0.141-0.023=0.118
min0.933-1.768=-0.835
max1.252-1.828=-0.575

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.754-466.748=0.007
σ575.933-575.932=0.002
min178.784-178.778=0.006
max1330.654-1330.645=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2772.000-2452.000=320.000
σ0.000
min2772.000-2452.000=320.000
max2772.000-2452.000=320.000
mean0.442-0.578=-0.136
σ0.303-0.595=-0.292
min0.287-0.280=0.008
max0.898-1.471=-0.574
policies=20
mean1788.138-1788.114=0.025
σ0.378-0.375=0.002
min1787.890-1787.872=0.018
max1788.697-1788.672=0.025
mean820.000
σ0.000
min820.000
max820.000
mean2772.000-2452.000=320.000
σ0.000
min2772.000-2452.000=320.000
max2772.000-2452.000=320.000
mean2.851-2.792=0.059
σ0.088-0.007=0.081
min2.774-2.785=-0.011
max2.970-2.801=0.169
policies=200
mean17888.018-17888.169=-0.151
σ0.427-0.508=-0.081
min17887.612-17887.898=-0.286
max17888.618-17888.931=-0.313
mean8200.000
σ0.000
min8200.000
max8200.000
mean2772.000-2452.000=320.000
σ0.000
min2772.000-2452.000=320.000
max2772.000-2452.000=320.000
mean28.188-28.069=0.120
σ0.112-0.178=-0.066
min28.092-27.821=0.271
max28.331-28.230=0.101