Compare commits

Home / Compare a695102e .. 5bcd6ecf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.047=-0.001
σ0.048-0.049=-0.001
min73.023-73.025=-0.002
max73.182-73.187=-0.005
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.158-0.161=-0.004
σ0.005-0.003=0.002
min0.151-0.158=-0.008
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.741-23.741=-0.000
σ0.003-0.003=0.000
min23.735-23.738=-0.003
max23.747-23.749=-0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.066=-0.002
σ0.004-0.003=0.001
min0.059-0.065=-0.005
max0.074-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.788=-0.001
σ0.358-0.360=-0.002
min1758.212-1758.219=-0.007
max1759.357-1759.372=-0.014
mean1657.350-1645.450=11.900
σ632.401-627.648=4.753
min616.000-617.000=-1.000
max2893.000-2769.000=124.000
mean2.862-2.895=-0.033
σ0.135-0.226=-0.091
min2.624-2.206=0.418
max3.137-3.400=-0.263

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-324.015=-0.003
σ0.052-0.049=0.003
min323.919-323.928=-0.009
max324.044-324.048=-0.004
mean2893.000-2769.000=124.000
σ0.000
min2893.000-2769.000=124.000
max2893.000-2769.000=124.000
mean0.426-0.428=-0.002
σ0.002-0.006=-0.004
min0.423-0.423=-0.000
max0.427-0.437=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1984.572-1984.599=-0.026
σ0.013-0.006=0.007
min1984.556-1984.588=-0.031
max1984.591-1984.603=-0.012
mean2893.000-2769.000=124.000
σ0.000
min2893.000-2769.000=124.000
max2893.000-2769.000=124.000
mean2.607-2.671=-0.064
σ0.159-0.193=-0.035
min2.488-2.503=-0.015
max2.874-2.890=-0.016
iters=5
new-facts=6402
prior-facts=1
mean4808.123-4808.076=0.047
σ7.483-7.859=-0.376
min4804.701-4804.183=0.518
max4821.509-4822.125=-0.616
mean2893.000-2769.000=124.000
σ0.000
min2893.000-2769.000=124.000
max2893.000-2769.000=124.000
mean8.779-8.331=0.448
σ0.224-0.464=-0.240
min8.410-7.718=0.692
max9.017-8.874=0.143
iters=5
new-facts=6402
prior-facts=6402
mean4995.667-4995.802=-0.135
σ0.202-0.026=0.176
min4995.431-4995.763=-0.332
max4995.832-4995.834=-0.002
mean3038.200-3031.400=6.800
σ175.565-214.351=-38.786
min2893.000-2769.000=124.000
max3323.000-3321.000=2.000
mean8.605-8.654=-0.050
σ0.117-0.170=-0.054
min8.504-8.451=0.052
max8.797-8.858=-0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.051=-0.012
σ0.149-0.173=-0.023
min0.912-0.911=0.002
max1.282-1.337=-0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.352-468.351=0.001
σ574.227-574.232=-0.005
min181.229-181.232=-0.003
max1329.692-1329.699=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2893.000-2769.000=124.000
σ0.000
min2893.000-2769.000=124.000
max2893.000-2769.000=124.000
mean0.430-0.444=-0.013
σ0.308-0.301=0.008
min0.242-0.290=-0.048
max0.891-0.894=-0.003
policies=20
mean1812.604-1812.628=-0.024
σ0.389-0.411=-0.022
min1812.329-1812.341=-0.013
max1813.174-1813.232=-0.058
mean840.000
σ0.000
min840.000
max840.000
mean2893.000-2769.000=124.000
σ0.000
min2893.000-2769.000=124.000
max2893.000-2769.000=124.000
mean2.899-2.890=0.010
σ0.014-0.021=-0.007
min2.882-2.865=0.016
max2.913-2.916=-0.004
policies=200
mean18132.540-18131.569=0.972
σ0.747-0.470=0.278
min18131.507-18131.217=0.290
max18133.119-18132.220=0.899
mean8400.000
σ0.000
min8400.000
max8400.000
mean2893.000-2769.000=124.000
σ0.000
min2893.000-2769.000=124.000
max2893.000-2769.000=124.000
mean28.770-28.397=0.373
σ0.335-0.198=0.136
min28.413-28.249=0.164
max29.122-28.688=0.434