Compare commits

Home / Compare 85adc51d .. 2ded326f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.225-35.224=0.001
σ0.053-0.055=-0.002
min35.197-35.189=0.008
max35.376-35.379=-0.004
mean414.700-412.000=2.700
σ0.483-0.000=0.483
min414.000-412.000=2.000
max415.000-412.000=3.000
mean0.085-0.085=-0.001
σ0.004-0.004=0.000
min0.082-0.083=-0.001
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.755-23.755=0.000
σ0.003-0.003=0.000
min23.750-23.752=-0.002
max23.758-23.761=-0.003
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.068-0.069=-0.000
σ0.003-0.004=-0.001
min0.066-0.066=0.000
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1756.356=0.001
σ0.365-0.367=-0.002
min1755.786-1755.784=0.002
max1756.945-1756.936=0.009
mean1644.700-1643.150=1.550
σ632.608-634.624=-2.016
min627.000-624.000=3.000
max2840.000-2825.000=15.000
mean2.345-2.340=0.005
σ0.090-0.108=-0.018
min2.139-2.177=-0.038
max2.530-2.620=-0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.578-324.560=0.018
σ0.040-0.048=-0.008
min324.507-324.477=0.030
max324.604-324.596=0.008
mean2840.000-2825.000=15.000
σ0.000
min2840.000-2825.000=15.000
max2840.000-2825.000=15.000
mean0.427-0.432=-0.005
σ0.008-0.009=-0.001
min0.421-0.425=-0.004
max0.441-0.444=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.131-1985.127=0.005
σ0.014-0.025=-0.011
min1985.112-1985.090=0.022
max1985.147-1985.149=-0.002
mean2840.000-2825.000=15.000
σ0.000
min2840.000-2825.000=15.000
max2840.000-2825.000=15.000
mean2.587-2.600=-0.013
σ0.099-0.136=-0.037
min2.486-2.432=0.054
max2.750-2.772=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4808.761-4808.657=0.104
σ7.713-7.720=-0.007
min4805.251-4804.715=0.537
max4822.559-4822.458=0.101
mean2840.000-2825.000=15.000
σ0.000
min2840.000-2825.000=15.000
max2840.000-2825.000=15.000
mean9.087-8.522=0.566
σ0.296-0.417=-0.121
min8.670-7.897=0.774
max9.428-8.939=0.489
iters=5
new-facts=6402
prior-facts=6402
mean4996.189-4996.264=-0.074
σ0.321-0.163=0.159
min4995.615-4995.975=-0.360
max4996.353-4996.355=-0.002
mean3019.600-3046.200=-26.600
σ254.909-196.248=58.662
min2840.000-2825.000=15.000
max3418.000-3327.000=91.000
mean8.471-8.599=-0.128
σ0.023-0.147=-0.125
min8.453-8.455=-0.002
max8.505-8.831=-0.326

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.972-0.985=-0.013
σ0.067-0.141=-0.074
min0.914-0.921=-0.006
max1.050-1.238=-0.187

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.965-462.967=-0.001
σ574.254-574.253=0.001
min175.827-175.829=-0.002
max1324.346-1324.346=0.000
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2825.000=15.000
σ0.000
min2840.000-2825.000=15.000
max2840.000-2825.000=15.000
mean0.433-0.468=-0.035
σ0.298-0.375=-0.077
min0.281-0.278=0.003
max0.879-1.031=-0.151
policies=20
mean1758.613-1758.614=-0.001
σ0.345-0.354=-0.009
min1758.379-1758.377=0.003
max1759.123-1759.139=-0.016
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2825.000=15.000
σ0.000
min2840.000-2825.000=15.000
max2840.000-2825.000=15.000
mean2.797-2.799=-0.002
σ0.005-0.015=-0.010
min2.792-2.777=0.015
max2.804-2.810=-0.006
policies=200
mean17592.187-17592.334=-0.147
σ0.770-0.689=0.081
min17591.104-17591.382=-0.278
max17592.848-17592.853=-0.005
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2825.000=15.000
σ0.000
min2840.000-2825.000=15.000
max2840.000-2825.000=15.000
mean28.016-27.946=0.069
σ0.391-0.346=0.045
min27.665-27.597=0.068
max28.445-28.347=0.099