Compare commits

Home / Compare 8c9908d4 .. 0798db12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.385=0.005
σ0.046-0.048=-0.002
min70.361-70.358=0.003
max70.518-70.518=-0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.159-0.158=0.002
σ0.003-0.005=-0.001
min0.157-0.150=0.006
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.002
σ0.002-0.002=-0.000
min21.143-21.138=0.005
max21.149-21.145=0.003
mean413.000-414.700=-1.700
σ0.000-0.483=-0.483
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.002
min0.059-0.063=-0.003
max0.071-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.394=0.001
σ0.361-0.362=-0.001
min1751.820-1751.825=-0.005
max1752.980-1752.977=0.003
mean1654.400-1653.900=0.500
σ645.809-646.062=-0.252
min631.000
max2850.000-2849.000=1.000
mean2.827-2.804=0.023
σ0.179-0.195=-0.016
min2.134-2.302=-0.167
max2.986-3.060=-0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.145-270.144=0.001
σ0.008-0.006=0.002
min270.136-270.135=0.001
max270.153-270.149=0.003
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean0.380-0.380=0.000
σ0.006-0.006=-0.000
min0.371-0.371=-0.000
max0.388-0.389=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.608-1930.595=0.013
σ0.010-0.016=-0.006
min1930.594-1930.577=0.017
max1930.620-1930.612=0.008
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean2.550-2.540=0.010
σ0.147-0.175=-0.027
min2.437-2.388=0.049
max2.783-2.838=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4751.316-4751.290=0.025
σ0.852-0.938=-0.086
min4750.824-4750.751=0.074
max4752.830-4752.959=-0.128
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean8.500-8.685=-0.185
σ0.400-0.644=-0.244
min7.893-7.665=0.229
max9.016-9.269=-0.253
iters=5
new-facts=6402
prior-facts=6402
mean4941.771-4941.625=0.146
σ0.019-0.184=-0.165
min4941.750-4941.418=0.331
max4941.794-4941.777=0.017
mean3057.800-3052.000=5.800
σ193.984-199.959=-5.975
min2850.000-2849.000=1.000
max3336.000-3310.000=26.000
mean8.557-8.557=0.000
σ0.223-0.163=0.060
min8.374-8.375=-0.001
max8.901-8.747=0.154

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.007=-0.011
σ0.154-0.139=0.015
min0.925-0.944=-0.019
max1.272-1.256=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.381-466.377=0.004
σ575.941-575.925=0.016
min178.397-178.404=-0.006
max1330.293-1330.265=0.028
mean84.250
σ8.500
min80.000
max97.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean0.527-0.444=0.083
σ0.476-0.307=0.169
min0.284-0.289=-0.005
max1.242-0.905=0.336
policies=20
mean1784.359-1784.359=0.000
σ0.369-0.360=0.010
min1784.101-1784.116=-0.015
max1784.903-1784.889=0.014
mean800.000
σ0.000
min800.000
max800.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean2.862-2.873=-0.011
σ0.017-0.006=0.012
min2.849-2.869=-0.020
max2.887-2.881=0.006
policies=200
mean17849.946-17849.840=0.105
σ0.366-0.443=-0.077
min17849.680-17849.549=0.132
max17850.483-17850.497=-0.014
mean8000.000
σ0.000
min8000.000
max8000.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean28.515-28.493=0.022
σ0.647-0.475=0.172
min27.874-28.073=-0.200
max29.080-28.938=0.142