Compare commits

Home / Compare c19ad866 .. 4e131b72

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.983-33.982=0.001
σ0.048-0.047=0.001
min33.955-33.955=-0.000
max34.114-34.112=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.085-0.082=0.003
σ0.004-0.005=-0.000
min0.081-0.076=0.005
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.001
σ0.004-0.003=0.001
min23.310-23.313=-0.003
max23.323-23.321=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.065=-0.000
σ0.002-0.002=0.000
min0.062-0.061=0.002
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.429=-0.001
σ0.365-0.365=0.000
min1756.854-1756.855=-0.001
max1758.014-1758.012=0.002
mean1641.850-1648.750=-6.900
σ631.920-629.705=2.214
min622.000-638.000=-16.000
max2794.000-2822.000=-28.000
mean2.368-2.372=-0.004
σ0.091-0.130=-0.039
min2.204-2.126=0.078
max2.519-2.706=-0.187

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.574-326.575=-0.001
σ0.046-0.049=-0.003
min326.495-326.490=0.005
max326.612-326.617=-0.005
mean2794.000-2822.000=-28.000
σ0.000
min2794.000-2822.000=-28.000
max2794.000-2822.000=-28.000
mean0.422-0.424=-0.002
σ0.003-0.004=-0.001
min0.419-0.420=-0.002
max0.427-0.429=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1988.724-1988.737=-0.013
σ0.027-0.016=0.011
min1988.688-1988.715=-0.027
max1988.750-1988.751=-0.001
mean2794.000-2822.000=-28.000
σ0.000
min2794.000-2822.000=-28.000
max2794.000-2822.000=-28.000
mean2.776-2.668=0.108
σ0.309-0.081=0.227
min2.556-2.553=0.002
max3.321-2.777=0.544
iters=5
new-facts=6402
prior-facts=1
mean4813.525-4813.429=0.096
σ7.631-7.696=-0.065
min4810.081-4809.512=0.569
max4827.176-4827.186=-0.010
mean2794.000-2822.000=-28.000
σ0.000
min2794.000-2822.000=-28.000
max2794.000-2822.000=-28.000
mean8.870-8.775=0.095
σ0.217-0.263=-0.046
min8.588-8.476=0.112
max9.119-9.156=-0.037
iters=5
new-facts=6402
prior-facts=6402
mean5001.139-5001.136=0.003
σ0.023-0.023=-0.000
min5001.112-5001.115=-0.003
max5001.169-5001.174=-0.005
mean3018.200-3022.200=-4.000
σ226.734-204.910=21.824
min2794.000-2822.000=-28.000
max3327.000-3307.000=20.000
mean9.787-9.743=0.044
σ0.084-0.290=-0.206
min9.744-9.241=0.503
max9.937-9.979=-0.042

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.947-0.972=-0.024
σ0.059-0.068=-0.009
min0.915-0.912=0.003
max1.050-1.052=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.333-464.333=-0.000
σ574.294-574.297=-0.003
min177.174-177.176=-0.002
max1325.774-1325.778=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2794.000-2822.000=-28.000
σ0.000
min2794.000-2822.000=-28.000
max2794.000-2822.000=-28.000
mean0.435-0.434=0.001
σ0.308-0.302=0.006
min0.279-0.282=-0.003
max0.897-0.886=0.011
policies=20
mean1772.056-1772.072=-0.017
σ0.359-0.359=-0.000
min1771.818-1771.831=-0.013
max1772.588-1772.605=-0.016
mean840.000
σ0.000
min840.000
max840.000
mean2794.000-2822.000=-28.000
σ0.000
min2794.000-2822.000=-28.000
max2794.000-2822.000=-28.000
mean2.785-2.796=-0.011
σ0.009-0.012=-0.003
min2.774-2.787=-0.013
max2.793-2.814=-0.020
policies=200
mean17727.601-17727.649=-0.048
σ0.521-0.495=0.027
min17727.291-17727.259=0.032
max17728.381-17728.365=0.016
mean8400.000
σ0.000
min8400.000
max8400.000
mean2794.000-2822.000=-28.000
σ0.000
min2794.000-2822.000=-28.000
max2794.000-2822.000=-28.000
mean27.500-27.903=-0.403
σ0.134-0.379=-0.245
min27.303-27.579=-0.275
max27.604-28.360=-0.757