Compare commits

Home / Compare 63b4234a .. de5a4d05

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.968=0.004
σ0.107-0.103=0.004
min35.924-35.926=-0.002
max36.276-36.262=0.015
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.074-0.077=-0.002
σ0.005-0.003=0.002
min0.070-0.074=-0.004
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.003-0.004=-0.001
min26.205-26.201=0.004
max26.214-26.214=0.000
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.061-0.061=0.000
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.376-1757.759=0.617
σ0.372-0.368=0.004
min1757.800-1757.182=0.618
max1758.977-1758.351=0.626
mean1659.250-1652.600=6.650
σ622.552-635.937=-13.385
min688.000-629.000=59.000
max2756.000-2817.000=-61.000
mean2.400-2.386=0.014
σ0.112-0.112=0.001
min2.289-2.273=0.016
max2.659-2.693=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-278.941=0.601
σ0.008-0.010=-0.002
min279.532-278.931=0.601
max279.549-278.953=0.596
mean2756.000-2817.000=-61.000
σ0.000
min2756.000-2817.000=-61.000
max2756.000-2817.000=-61.000
mean0.410-0.408=0.002
σ0.006-0.005=0.001
min0.407-0.403=0.005
max0.421-0.413=0.008
iters=5
new-facts=1
prior-facts=6402
mean2178.464-2177.854=0.610
σ0.026-0.030=-0.004
min2178.434-2177.822=0.613
max2178.500-2177.896=0.604
mean2756.000-2817.000=-61.000
σ0.000
min2756.000-2817.000=-61.000
max2756.000-2817.000=-61.000
mean3.449-3.390=0.059
σ0.089-0.209=-0.121
min3.316-3.156=0.160
max3.560-3.640=-0.080
iters=5
new-facts=6402
prior-facts=1
mean5056.168-5055.791=0.376
σ1.156-0.942=0.215
min5055.229-5055.235=-0.006
max5058.164-5057.466=0.697
mean2756.000-2817.000=-61.000
σ0.000
min2756.000-2817.000=-61.000
max2756.000-2817.000=-61.000
mean9.029-8.531=0.498
σ0.629-0.503=0.126
min8.124-8.092=0.031
max9.725-9.193=0.532
iters=5
new-facts=6402
prior-facts=6402
mean5193.509-5193.167=0.342
σ0.373-0.099=0.274
min5193.018-5193.048=-0.031
max5193.886-5193.279=0.608
mean3236.400-3230.200=6.200
σ348.902-424.920=-76.017
min2756.000-2817.000=-61.000
max3671.000-3844.000=-173.000
mean9.009-8.865=0.144
σ0.382-0.257=0.125
min8.699-8.629=0.070
max9.646-9.220=0.426

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-0.981=-0.000
σ0.052-0.053=-0.001
min0.950-0.950=0.000
max1.071-1.074=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.539-464.298=1.241
σ572.664-572.655=0.009
min179.198-177.962=1.236
max1324.536-1323.281=1.255
mean79.500-81.500=-2.000
σ7.000
min76.000-78.000=-2.000
max90.000-92.000=-2.000
mean2756.000-2817.000=-61.000
σ0.000
min2756.000-2817.000=-61.000
max2756.000-2817.000=-61.000
mean0.474-0.437=0.036
σ0.374-0.298=0.076
min0.287-0.286=0.001
max1.034-0.884=0.151
policies=20
mean1792.274-1779.938=12.336
σ0.317-0.391=-0.074
min1792.086-1779.686=12.400
max1792.746-1780.516=12.230
mean760.000-780.000=-20.000
σ0.000
min760.000-780.000=-20.000
max760.000-780.000=-20.000
mean2756.000-2817.000=-61.000
σ0.000
min2756.000-2817.000=-61.000
max2756.000-2817.000=-61.000
mean2.819-2.898=-0.078
σ0.005-0.086=-0.081
min2.813-2.845=-0.032
max2.825-3.027=-0.201
policies=200
mean17929.310-17805.902=123.408
σ0.530-0.527=0.003
min17928.995-17805.547=123.449
max17930.102-17806.685=123.417
mean7600.000-7800.000=-200.000
σ0.000
min7600.000-7800.000=-200.000
max7600.000-7800.000=-200.000
mean2756.000-2817.000=-61.000
σ0.000
min2756.000-2817.000=-61.000
max2756.000-2817.000=-61.000
mean28.382-28.045=0.337
σ0.093-0.054=0.039
min28.286-27.981=0.305
max28.466-28.109=0.356