Compare commits

Home / Compare 27ca750e .. f0f477c1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.782=-0.001
σ0.047-0.044=0.003
min70.747-70.749=-0.002
max70.909-70.905=0.004
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.155-0.161=-0.006
σ0.006-0.003=0.003
min0.150-0.157=-0.007
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.493=-0.001
σ0.003-0.002=0.001
min21.488-21.489=-0.001
max21.497-21.496=0.001
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.063-0.064=-0.001
σ0.004-0.003=0.000
min0.060-0.058=0.002
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.092=0.001
σ0.361-0.361=-0.000
min1753.534-1753.531=0.004
max1754.693-1754.682=0.011
mean1661.000-1669.200=-8.200
σ636.277-637.477=-1.200
min627.000-686.000=-59.000
max2781.000-2730.000=51.000
mean2.827-2.824=0.003
σ0.180-0.154=0.026
min2.509-2.540=-0.031
max3.394-3.053=0.341

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.600=0.355
σ0.006-0.008=-0.002
min271.951-271.594=0.357
max271.965-271.609=0.357
mean2781.000-2730.000=51.000
σ0.000
min2781.000-2730.000=51.000
max2781.000-2730.000=51.000
mean0.381-0.386=-0.005
σ0.004-0.008=-0.004
min0.378-0.379=-0.001
max0.388-0.395=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1932.328-1932.004=0.324
σ0.009-0.012=-0.002
min1932.317-1931.985=0.332
max1932.336-1932.014=0.323
mean2781.000-2730.000=51.000
σ0.000
min2781.000-2730.000=51.000
max2781.000-2730.000=51.000
mean3.012-2.506=0.506
σ0.188-0.085=0.103
min2.741-2.404=0.337
max3.256-2.609=0.647
iters=5
new-facts=6402
prior-facts=1
mean4753.064-4752.735=0.328
σ0.925-0.877=0.049
min4752.568-4752.203=0.365
max4754.716-4754.296=0.420
mean2781.000-2730.000=51.000
σ0.000
min2781.000-2730.000=51.000
max2781.000-2730.000=51.000
mean8.639-8.596=0.043
σ0.383-0.394=-0.012
min8.059-8.235=-0.177
max9.056-9.216=-0.160
iters=5
new-facts=6402
prior-facts=6402
mean4943.485-4943.150=0.335
σ0.152-0.144=0.009
min4943.213-4942.893=0.320
max4943.564-4943.226=0.338
mean3005.600-3039.400=-33.800
σ217.958-226.911=-8.953
min2781.000-2730.000=51.000
max3324.000-3331.000=-7.000
mean8.502-8.542=-0.040
σ0.231-0.126=0.106
min8.371-8.385=-0.015
max8.912-8.676=0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.107-1.117=-0.009
σ0.243-0.229=0.014
min0.940-0.936=0.004
max1.528-1.479=0.049

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.645-468.640=0.005
σ574.938-574.941=-0.003
min181.170-181.168=0.002
max1331.051-1331.051=0.000
mean88.250
σ8.500
min84.000
max101.000
mean2781.000-2730.000=51.000
σ0.000
min2781.000-2730.000=51.000
max2781.000-2730.000=51.000
mean0.450-0.565=-0.115
σ0.300-0.541=-0.241
min0.298-0.287=0.012
max0.900-1.376=-0.476
policies=20
mean1811.995-1811.970=0.025
σ0.404-0.385=0.019
min1811.710-1811.706=0.004
max1812.588-1812.539=0.048
mean840.000
σ0.000
min840.000
max840.000
mean2781.000-2730.000=51.000
σ0.000
min2781.000-2730.000=51.000
max2781.000-2730.000=51.000
mean2.935-2.841=0.094
σ0.053-0.008=0.045
min2.907-2.831=0.077
max3.014-2.851=0.163
policies=200
mean18126.793-18126.636=0.157
σ0.505-0.602=-0.097
min18126.503-18126.241=0.262
max18127.549-18127.517=0.032
mean8400.000
σ0.000
min8400.000
max8400.000
mean2781.000-2730.000=51.000
σ0.000
min2781.000-2730.000=51.000
max2781.000-2730.000=51.000
mean28.453-28.742=-0.289
σ0.092-0.050=0.043
min28.318-28.699=-0.381
max28.526-28.793=-0.267