Compare commits

Home / Compare eb6c4477 .. ca0e18f4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.768=-0.000
σ0.047-0.048=-0.002
min30.725-30.723=0.002
max30.896-30.901=-0.004
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.074-0.076=-0.002
σ0.004-0.004=0.000
min0.069-0.071=-0.001
max0.080-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.002=-0.000
min21.057-21.058=-0.001
max21.063-21.064=-0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.061-0.064=-0.003
σ0.003-0.003=0.000
min0.057-0.062=-0.005
max0.066-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.418=0.001
σ0.360-0.361=-0.001
min1750.856-1750.848=0.008
max1751.995-1751.999=-0.005
mean1660.400-1651.800=8.600
σ635.748-627.382=8.366
min625.000-678.000=-53.000
max2790.000-2658.000=132.000
mean2.790-2.816=-0.027
σ0.225-0.174=0.051
min2.153-2.414=-0.261
max3.003-3.038=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean282.193-282.193=0.001
σ0.008-0.008=-0.000
min282.184-282.182=0.002
max282.201-282.202=-0.000
mean2790.000-2658.000=132.000
σ0.000
min2790.000-2658.000=132.000
max2790.000-2658.000=132.000
mean0.408-0.407=0.001
σ0.003-0.004=-0.001
min0.403-0.403=-0.000
max0.413-0.414=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2174.715-2174.707=0.008
σ0.008-0.022=-0.013
min2174.705-2174.676=0.029
max2174.727-2174.730=-0.003
mean2790.000-2658.000=132.000
σ0.000
min2790.000-2658.000=132.000
max2790.000-2658.000=132.000
mean2.977-2.974=0.003
σ0.134-0.132=0.002
min2.808-2.758=0.050
max3.144-3.084=0.060
iters=5
new-facts=6402
prior-facts=1
mean5054.562-5054.545=0.018
σ1.018-0.971=0.047
min5053.954-5053.996=-0.042
max5056.366-5056.271=0.096
mean2790.000-2658.000=132.000
σ0.000
min2790.000-2658.000=132.000
max2790.000-2658.000=132.000
mean9.137-9.047=0.090
σ0.721-0.471=0.250
min8.047-8.361=-0.314
max10.043-9.568=0.475
iters=5
new-facts=6402
prior-facts=6402
mean5185.610-5185.668=-0.058
σ0.190-0.077=0.113
min5185.295-5185.595=-0.300
max5185.770-5185.763=0.007
mean3255.600-3230.200=25.400
σ364.611-395.253=-30.642
min2790.000-2690.000=100.000
max3739.000-3733.000=6.000
mean10.048-9.706=0.342
σ0.379-0.636=-0.256
min9.447-8.873=0.574
max10.493-10.411=0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.141-1.105=0.036
σ0.241-0.135=0.106
min0.940-0.925=0.015
max1.560-1.242=0.318

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-463.574=0.004
σ572.661-572.668=-0.006
min177.241-177.237=0.003
max1322.570-1322.576=-0.006
mean79.750
σ7.500
min76.000
max91.000
mean2790.000-2658.000=132.000
σ0.000
min2790.000-2658.000=132.000
max2790.000-2658.000=132.000
mean0.474-0.566=-0.093
σ0.379-0.567=-0.188
min0.278-0.277=0.002
max1.041-1.416=-0.375
policies=20
mean1772.667-1772.641=0.026
σ0.310-0.323=-0.013
min1772.443-1772.417=0.026
max1773.119-1773.119=0.000
mean760.000
σ0.000
min760.000
max760.000
mean2790.000-2658.000=132.000
σ0.000
min2790.000-2658.000=132.000
max2790.000-2658.000=132.000
mean2.811-2.730=0.081
σ0.115-0.007=0.109
min2.730-2.723=0.007
max2.982-2.737=0.244
policies=200
mean17733.012-17733.024=-0.012
σ0.512-0.463=0.049
min17732.725-17732.762=-0.036
max17733.777-17733.716=0.062
mean7600.000
σ0.000
min7600.000
max7600.000
mean2790.000-2658.000=132.000
σ0.000
min2790.000-2658.000=132.000
max2790.000-2658.000=132.000
mean27.698-27.686=0.012
σ0.143-0.169=-0.026
min27.509-27.512=-0.003
max27.855-27.916=-0.061