Compare commits

Home / Compare ad0652a0 .. 96f0ff28

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.048-0.047=0.001
min33.948-33.947=0.001
max34.112-34.106=0.006
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.083-0.081=0.002
σ0.005-0.005=-0.000
min0.077-0.076=0.001
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.003-0.002=0.001
min23.313-23.313=-0.000
max23.321-23.319=0.003
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.064-0.063=0.001
σ0.004-0.005=-0.001
min0.059-0.059=0.001
max0.073-0.075=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.365-1757.364=0.001
σ0.364-0.364=-0.000
min1756.792-1756.787=0.005
max1757.953-1757.952=0.001
mean1664.100-1663.350=0.750
σ628.600-624.225=4.374
min668.000-618.000=50.000
max2613.000-2715.000=-102.000
mean2.359-2.335=0.023
σ0.122-0.098=0.024
min2.240-2.190=0.049
max2.743-2.639=0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.506-326.512=-0.006
σ0.049-0.030=0.019
min326.418-326.459=-0.041
max326.532-326.531=0.001
mean2613.000-2715.000=-102.000
σ0.000
min2613.000-2715.000=-102.000
max2613.000-2715.000=-102.000
mean0.427-0.424=0.003
σ0.003-0.001=0.002
min0.423-0.422=0.002
max0.431-0.426=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.677-1988.673=0.004
σ0.011-0.009=0.001
min1988.663-1988.660=0.003
max1988.688-1988.685=0.003
mean2613.000-2715.000=-102.000
σ0.000
min2613.000-2715.000=-102.000
max2613.000-2715.000=-102.000
mean2.807-2.667=0.140
σ0.205-0.038=0.167
min2.574-2.633=-0.059
max3.036-2.731=0.305
iters=5
new-facts=6402
prior-facts=1
mean4813.465-4813.506=-0.041
σ7.418-7.732=-0.314
min4809.963-4809.979=-0.016
max4826.730-4827.336=-0.606
mean2613.000-2715.000=-102.000
σ0.000
min2613.000-2715.000=-102.000
max2613.000-2715.000=-102.000
mean8.357-8.820=-0.463
σ0.745-0.217=0.527
min7.640-8.632=-0.993
max9.389-9.145=0.244
iters=5
new-facts=6402
prior-facts=6402
mean5001.004-5001.080=-0.075
σ0.143-0.037=0.106
min5000.751-5001.046=-0.296
max5001.087-5001.139=-0.052
mean2960.000-3005.200=-45.200
σ361.124-262.305=98.819
min2613.000-2715.000=-102.000
max3442.000-3369.000=73.000
mean9.752-9.915=-0.163
σ0.226-0.335=-0.109
min9.421-9.707=-0.286
max10.059-10.509=-0.449

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.250-0.949=0.301
σ0.396-0.055=0.341
min0.922-0.915=0.007
max1.815-1.045=0.770

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.500-464.502=-0.002
σ574.789-574.771=0.018
min177.103-177.108=-0.005
max1326.684-1326.659=0.025
mean88.250
σ8.500
min84.000
max101.000
mean2613.000-2715.000=-102.000
σ0.000
min2613.000-2715.000=-102.000
max2613.000-2715.000=-102.000
mean0.548-0.549=-0.001
σ0.547-0.552=-0.005
min0.272-0.269=0.003
max1.368-1.377=-0.009
policies=20
mean1771.362-1771.393=-0.030
σ0.356-0.349=0.008
min1771.120-1771.165=-0.044
max1771.890-1771.912=-0.022
mean840.000
σ0.000
min840.000
max840.000
mean2613.000-2715.000=-102.000
σ0.000
min2613.000-2715.000=-102.000
max2613.000-2715.000=-102.000
mean2.722-2.720=0.002
σ0.016-0.012=0.003
min2.702-2.704=-0.002
max2.739-2.732=0.008
policies=200
mean17721.007-17721.106=-0.099
σ0.417-0.506=-0.089
min17720.672-17720.843=-0.171
max17721.617-17721.865=-0.248
mean8400.000
σ0.000
min8400.000
max8400.000
mean2613.000-2715.000=-102.000
σ0.000
min2613.000-2715.000=-102.000
max2613.000-2715.000=-102.000
mean27.603-27.535=0.068
σ0.082-0.082=0.000
min27.497-27.436=0.061
max27.678-27.627=0.051