Compare commits

Home / Compare e56d91f8 .. b99dbede

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.000
σ0.048-0.047=0.001
min33.951-33.950=0.001
max34.111-34.110=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.085-0.086=-0.001
σ0.003-0.003=-0.001
min0.083-0.083=-0.000
max0.090-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.003=-0.000
min23.314-23.314=0.000
max23.325-23.322=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.062=0.004
σ0.003-0.003=0.000
min0.062-0.060=0.002
max0.074-0.070=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.496=-0.002
σ0.363-0.364=-0.001
min1756.920-1756.922=-0.003
max1758.077-1758.084=-0.007
mean1676.200-1669.250=6.950
σ628.479-618.830=9.649
min668.000
max2613.000-2605.000=8.000
mean2.384-2.377=0.007
σ0.133-0.156=-0.023
min2.246-2.237=0.010
max2.733-2.980=-0.247

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.645-326.604=0.041
σ0.030-0.045=-0.015
min326.591-326.524=0.067
max326.666-326.632=0.033
mean2613.000-2605.000=8.000
σ0.000
min2613.000-2605.000=8.000
max2613.000-2605.000=8.000
mean0.424-0.427=-0.003
σ0.005-0.006=-0.001
min0.421-0.423=-0.002
max0.432-0.435=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1988.806-1988.804=0.001
σ0.007-0.011=-0.004
min1988.794-1988.788=0.006
max1988.812-1988.817=-0.005
mean2613.000-2605.000=8.000
σ0.000
min2613.000-2605.000=8.000
max2613.000-2605.000=8.000
mean2.702-2.707=-0.006
σ0.073-0.112=-0.040
min2.646-2.622=0.024
max2.827-2.903=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4813.713-4813.686=0.027
σ7.711-7.697=0.015
min4810.104-4810.104=-0.000
max4827.507-4827.453=0.054
mean2613.000-2605.000=8.000
σ0.000
min2613.000-2605.000=8.000
max2613.000-2605.000=8.000
mean8.230-8.269=-0.039
σ0.656-0.595=0.061
min7.762-7.793=-0.032
max9.317-9.207=0.110
iters=5
new-facts=6402
prior-facts=6402
mean5001.199-5001.205=-0.007
σ0.024-0.034=-0.010
min5001.173-5001.175=-0.002
max5001.223-5001.253=-0.029
mean2932.800-2946.200=-13.400
σ355.045-363.059=-8.013
min2613.000-2605.000=8.000
max3446.000-3441.000=5.000
mean9.609-9.620=-0.011
σ0.247-0.712=-0.465
min9.308-8.442=0.866
max9.823-10.384=-0.561

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.159-1.220=-0.061
σ0.332-0.355=-0.023
min0.911-0.909=0.002
max1.719-1.769=-0.050

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.630=-0.001
σ574.784-574.787=-0.003
min177.230-177.235=-0.005
max1326.805-1326.811=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2613.000-2605.000=8.000
σ0.000
min2613.000-2605.000=8.000
max2613.000-2605.000=8.000
mean0.557-0.555=0.002
σ0.564-0.567=-0.003
min0.274-0.269=0.005
max1.403-1.405=-0.003
policies=20
mean1772.656-1772.685=-0.028
σ0.349-0.363=-0.014
min1772.422-1772.431=-0.009
max1773.175-1773.223=-0.047
mean840.000
σ0.000
min840.000
max840.000
mean2613.000-2605.000=8.000
σ0.000
min2613.000-2605.000=8.000
max2613.000-2605.000=8.000
mean2.731-2.722=0.010
σ0.007-0.009=-0.002
min2.723-2.711=0.012
max2.739-2.730=0.009
policies=200
mean17733.957-17734.062=-0.104
σ0.427-0.464=-0.038
min17733.560-17733.796=-0.237
max17734.553-17734.756=-0.203
mean8400.000
σ0.000
min8400.000
max8400.000
mean2613.000-2605.000=8.000
σ0.000
min2613.000-2605.000=8.000
max2613.000-2605.000=8.000
mean27.569-27.510=0.059
σ0.108-0.156=-0.048
min27.437-27.316=0.121
max27.684-27.695=-0.011