Compare commits

Home / Compare e4a05be0 .. 400614e5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.966=0.001
σ0.103-0.101=0.002
min35.924-35.928=-0.004
max36.260-36.254=0.006
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.077-0.076=0.000
σ0.004-0.003=0.001
min0.071-0.074=-0.003
max0.084-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.207=0.001
σ0.003-0.003=-0.001
min26.203-26.200=0.003
max26.214-26.213=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.060-0.058=0.002
σ0.004-0.003=0.001
min0.056-0.056=0.000
max0.067-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.761-1757.760=0.000
σ0.371-0.369=0.002
min1757.182-1757.182=-0.000
max1758.361-1758.357=0.004
mean1652.400-1651.700=0.700
σ636.592-625.237=11.355
min620.000-627.000=-7.000
max2817.000-2749.000=68.000
mean2.339-2.391=-0.053
σ0.086-0.164=-0.078
min2.251-2.201=0.050
max2.552-2.883=-0.331

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.943-280.285=-1.342
σ0.009-0.011=-0.001
min278.932-280.273=-1.341
max278.955-280.302=-1.347
mean2817.000-2749.000=68.000
σ0.000
min2817.000-2749.000=68.000
max2817.000-2749.000=68.000
mean0.408-0.417=-0.009
σ0.004-0.007=-0.004
min0.401-0.410=-0.009
max0.410-0.428=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2177.862-2270.305=-92.442
σ0.014-0.015=-0.001
min2177.839-2270.286=-92.447
max2177.874-2270.323=-92.449
mean2817.000-2749.000=68.000
σ0.000
min2817.000-2749.000=68.000
max2817.000-2749.000=68.000
mean3.291-3.192=0.099
σ0.160-0.382=-0.221
min3.048-2.792=0.255
max3.496-3.706=-0.210
iters=5
new-facts=6402
prior-facts=1
mean5055.823-5147.275=-91.452
σ0.941-0.601=0.341
min5055.338-5146.603=-91.265
max5057.503-5148.225=-90.722
mean2817.000-2749.000=68.000
σ0.000
min2817.000-2749.000=68.000
max2817.000-2749.000=68.000
mean8.409-8.994=-0.584
σ0.529-0.738=-0.209
min7.998-8.245=-0.247
max9.333-9.931=-0.598
iters=5
new-facts=6402
prior-facts=6402
mean5193.108-5285.582=-92.475
σ0.121-0.125=-0.004
min5192.929-5285.391=-92.463
max5193.270-5285.735=-92.465
mean3179.600-3465.400=-285.800
σ364.815-445.008=-80.193
min2865.000-2837.000=28.000
max3722.000-3997.000=-275.000
mean8.661-10.073=-1.412
σ0.116-0.367=-0.251
min8.559-9.621=-1.061
max8.854-10.618=-1.764

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-0.948=0.028
σ0.055-0.012=0.043
min0.942-0.938=0.004
max1.072-0.969=0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.303-464.288=0.015
σ572.655-572.611=0.044
min177.968-177.973=-0.005
max1323.285-1323.204=0.081
mean81.500
σ7.000
min78.000
max92.000
mean2817.000-2749.000=68.000
σ0.000
min2817.000-2749.000=68.000
max2817.000-2749.000=68.000
mean0.437-0.439=-0.002
σ0.303-0.304=-0.001
min0.283-0.283=-0.001
max0.892-0.895=-0.003
policies=20
mean1779.945-1779.919=0.026
σ0.368-0.309=0.059
min1779.705-1779.741=-0.036
max1780.489-1780.380=0.109
mean780.000
σ0.000
min780.000
max780.000
mean2817.000-2749.000=68.000
σ0.000
min2817.000-2749.000=68.000
max2817.000-2749.000=68.000
mean2.881-2.838=0.043
σ0.066-0.088=-0.023
min2.834-2.770=0.063
max2.977-2.967=0.010
policies=200
mean17805.950-17805.786=0.164
σ0.479-0.614=-0.135
min17805.689-17805.406=0.283
max17806.667-17806.704=-0.036
mean7800.000
σ0.000
min7800.000
max7800.000
mean2817.000-2749.000=68.000
σ0.000
min2817.000-2749.000=68.000
max2817.000-2749.000=68.000
mean27.856-28.057=-0.200
σ0.132-0.067=0.065
min27.661-27.957=-0.296
max27.949-28.098=-0.148