Compare commits

Home / Compare 750314b9 .. eb6c4477

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.769=-0.000
σ0.048-0.050=-0.002
min30.723-30.728=-0.005
max30.901-30.906=-0.006
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.076-0.077=-0.001
σ0.004-0.004=0.000
min0.071-0.071=-0.000
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.002-0.002=-0.000
min21.058-21.055=0.003
max21.064-21.064=0.000
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.064-0.061=0.003
σ0.003-0.004=-0.001
min0.062-0.056=0.006
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.418-1751.418=0.000
σ0.361-0.363=-0.002
min1750.848-1750.849=-0.001
max1751.999-1752.006=-0.007
mean1651.800-1657.150=-5.350
σ627.382-635.361=-7.979
min678.000-689.000=-11.000
max2658.000-2772.000=-114.000
mean2.816-2.805=0.012
σ0.174-0.153=0.021
min2.414-2.435=-0.022
max3.038-3.104=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.193-282.194=-0.001
σ0.008-0.008=-0.001
min282.182-282.180=0.002
max282.202-282.200=0.001
mean2658.000-2772.000=-114.000
σ0.000
min2658.000-2772.000=-114.000
max2658.000-2772.000=-114.000
mean0.407-0.408=-0.001
σ0.004-0.002=0.002
min0.403-0.405=-0.002
max0.414-0.411=0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.707-2174.713=-0.006
σ0.022-0.020=0.001
min2174.676-2174.677=-0.001
max2174.730-2174.728=0.002
mean2658.000-2772.000=-114.000
σ0.000
min2658.000-2772.000=-114.000
max2658.000-2772.000=-114.000
mean2.974-2.867=0.107
σ0.132-0.137=-0.006
min2.758-2.745=0.013
max3.084-3.068=0.016
iters=5
new-facts=6402
prior-facts=1
mean5054.545-5054.579=-0.034
σ0.971-0.938=0.033
min5053.996-5054.120=-0.124
max5056.271-5056.254=0.016
mean2658.000-2772.000=-114.000
σ0.000
min2658.000-2772.000=-114.000
max2658.000-2772.000=-114.000
mean9.047-8.892=0.155
σ0.471-0.545=-0.074
min8.361-8.181=0.180
max9.568-9.445=0.124
iters=5
new-facts=6402
prior-facts=6402
mean5185.668-5185.658=0.010
σ0.077-0.080=-0.003
min5185.595-5185.586=0.009
max5185.763-5185.750=0.013
mean3230.200-3273.600=-43.400
σ395.253-428.735=-33.482
min2690.000-2772.000=-82.000
max3733.000-3849.000=-116.000
mean9.706-9.722=-0.016
σ0.636-0.481=0.154
min8.873-8.996=-0.123
max10.411-10.121=0.290

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.105-1.114=-0.008
σ0.135-0.080=0.056
min0.925-1.061=-0.136
max1.242-1.255=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.580=-0.006
σ572.668-572.659=0.009
min177.237-177.242=-0.005
max1322.576-1322.568=0.008
mean79.750
σ7.500
min76.000
max91.000
mean2658.000-2772.000=-114.000
σ0.000
min2658.000-2772.000=-114.000
max2658.000-2772.000=-114.000
mean0.566-0.439=0.127
σ0.567-0.306=0.261
min0.277-0.284=-0.008
max1.416-0.898=0.518
policies=20
mean1772.641-1772.666=-0.025
σ0.323-0.313=0.010
min1772.417-1772.433=-0.016
max1773.119-1773.117=0.001
mean760.000
σ0.000
min760.000
max760.000
mean2658.000-2772.000=-114.000
σ0.000
min2658.000-2772.000=-114.000
max2658.000-2772.000=-114.000
mean2.730-2.805=-0.074
σ0.007-0.133=-0.126
min2.723-2.719=0.004
max2.737-3.003=-0.265
policies=200
mean17733.024-17733.012=0.012
σ0.463-0.513=-0.050
min17732.762-17732.671=0.090
max17733.716-17733.776=-0.060
mean7600.000
σ0.000
min7600.000
max7600.000
mean2658.000-2772.000=-114.000
σ0.000
min2658.000-2772.000=-114.000
max2658.000-2772.000=-114.000
mean27.686-27.693=-0.007
σ0.169-0.173=-0.005
min27.512-27.478=0.034
max27.916-27.847=0.069