Compare commits

Home / Compare 7489e3af .. 06842d69

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.973=-0.000
σ0.107-0.107=0.000
min35.924-35.922=0.002
max36.276-36.276=0.001
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.074-0.077=-0.003
σ0.005-0.004=0.001
min0.070-0.072=-0.002
max0.082-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.003-0.003=0.000
min26.205-26.204=0.001
max26.214-26.212=0.002
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.061-0.060=0.001
σ0.003-0.003=-0.000
min0.059-0.057=0.003
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.376-1758.379=-0.003
σ0.372-0.371=0.000
min1757.800-1757.803=-0.003
max1758.977-1758.979=-0.002
mean1659.250-1630.700=28.550
σ622.552-621.710=0.842
min688.000-637.000=51.000
max2756.000-2815.000=-59.000
mean2.400-2.377=0.023
σ0.112-0.115=-0.003
min2.289-2.283=0.006
max2.659-2.782=-0.123

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-279.542=0.000
σ0.008-0.010=-0.002
min279.532-279.532=-0.000
max279.549-279.555=-0.007
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean0.410-0.414=-0.004
σ0.006-0.008=-0.002
min0.407-0.408=-0.000
max0.421-0.425=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.464-2178.455=0.009
σ0.026-0.032=-0.006
min2178.434-2178.416=0.019
max2178.500-2178.493=0.006
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean3.449-3.341=0.108
σ0.089-0.069=0.020
min3.316-3.258=0.058
max3.560-3.426=0.134
iters=5
new-facts=6402
prior-facts=1
mean5056.168-5056.404=-0.236
σ1.156-0.993=0.164
min5055.229-5055.795=-0.566
max5058.164-5058.170=-0.006
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean9.029-8.918=0.110
σ0.629-0.615=0.015
min8.124-8.233=-0.110
max9.725-9.684=0.042
iters=5
new-facts=6402
prior-facts=6402
mean5193.509-5193.549=-0.039
σ0.373-0.364=0.008
min5193.018-5192.944=0.073
max5193.886-5193.881=0.006
mean3236.400-3296.400=-60.000
σ348.902-440.858=-91.956
min2756.000-2815.000=-59.000
max3671.000-3921.000=-250.000
mean9.009-8.898=0.112
σ0.382-0.055=0.328
min8.699-8.849=-0.149
max9.646-8.982=0.664

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.980-0.999=-0.019
σ0.052-0.068=-0.016
min0.950-0.944=0.006
max1.071-1.079=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.539-465.557=-0.018
σ572.664-572.658=0.006
min179.198-179.221=-0.023
max1324.536-1324.544=-0.008
mean79.500
σ7.000
min76.000
max90.000
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean0.474-0.449=0.025
σ0.374-0.307=0.066
min0.287-0.294=-0.007
max1.034-0.910=0.124
policies=20
mean1792.274-1792.468=-0.195
σ0.317-0.343=-0.026
min1792.086-1792.233=-0.147
max1792.746-1792.971=-0.225
mean760.000
σ0.000
min760.000
max760.000
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean2.819-2.910=-0.090
σ0.005-0.005=0.000
min2.813-2.903=-0.090
max2.825-2.913=-0.088
policies=200
mean17929.310-17929.927=-0.617
σ0.530-0.727=-0.197
min17928.995-17929.297=-0.301
max17930.102-17930.751=-0.649
mean7600.000
σ0.000
min7600.000
max7600.000
mean2756.000-2815.000=-59.000
σ0.000
min2756.000-2815.000=-59.000
max2756.000-2815.000=-59.000
mean28.382-28.713=-0.332
σ0.093-0.471=-0.378
min28.286-28.268=0.018
max28.466-29.371=-0.905