Compare commits

Home / Compare 1635eb76 .. d64550e6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.771-30.770=0.000
σ0.047-0.047=-0.001
min30.731-30.730=0.001
max30.899-30.900=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.078-0.078=0.000
σ0.003-0.004=-0.001
min0.076-0.075=0.001
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.003-0.002=0.001
min21.056-21.058=-0.001
max21.066-21.064=0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.063-0.062=0.001
σ0.002-0.004=-0.002
min0.061-0.058=0.003
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.420=-0.000
σ0.361-0.360=0.001
min1750.849-1750.854=-0.005
max1752.003-1751.999=0.004
mean1648.600-1652.650=-4.050
σ621.232-623.667=-2.435
min679.000-683.000=-4.000
max2644.000-2651.000=-7.000
mean2.815-2.851=-0.036
σ0.177-0.192=-0.016
min2.293-2.338=-0.046
max3.057-3.203=-0.146

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.756-275.756=0.000
σ0.008-0.009=-0.001
min275.749-275.744=0.004
max275.768-275.763=0.005
mean2644.000-2651.000=-7.000
σ0.000
min2644.000-2651.000=-7.000
max2644.000-2651.000=-7.000
mean0.405-0.406=-0.001
σ0.008-0.007=0.001
min0.398-0.398=0.001
max0.414-0.416=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.271-2168.282=-0.010
σ0.016-0.015=0.002
min2168.256-2168.261=-0.005
max2168.292-2168.302=-0.010
mean2644.000-2651.000=-7.000
σ0.000
min2644.000-2651.000=-7.000
max2644.000-2651.000=-7.000
mean2.869-2.857=0.013
σ0.126-0.200=-0.074
min2.753-2.653=0.099
max3.064-3.155=-0.091
iters=5
new-facts=6402
prior-facts=1
mean5048.094-5048.151=-0.057
σ0.926-1.002=-0.076
min5047.592-5047.548=0.044
max5049.748-5049.921=-0.173
mean2644.000-2651.000=-7.000
σ0.000
min2644.000-2651.000=-7.000
max2644.000-2651.000=-7.000
mean8.752-8.745=0.007
σ0.384-0.515=-0.130
min8.117-7.898=0.220
max9.062-9.164=-0.102
iters=5
new-facts=6402
prior-facts=6402
mean5179.157-5179.256=-0.098
σ0.191-0.098=0.093
min5178.846-5179.147=-0.301
max5179.322-5179.353=-0.030
mean3243.800-3259.800=-16.000
σ466.228-462.196=4.033
min2644.000-2655.000=-11.000
max3853.000-3877.000=-24.000
mean9.739-9.858=-0.119
σ0.242-0.266=-0.024
min9.562-9.510=0.052
max10.153-10.235=-0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.230-1.234=-0.003
σ0.259-0.372=-0.113
min1.075-0.950=0.125
max1.674-1.826=-0.153

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.572-463.573=-0.001
σ572.664-572.663=0.001
min177.235-177.238=-0.003
max1322.567-1322.567=0.000
mean79.750
σ7.500
min76.000
max91.000
mean2644.000-2651.000=-7.000
σ0.000
min2644.000-2651.000=-7.000
max2644.000-2651.000=-7.000
mean0.542-0.574=-0.032
σ0.528-0.594=-0.066
min0.274-0.272=0.002
max1.333-1.465=-0.132
policies=20
mean1772.647-1772.615=0.033
σ0.329-0.331=-0.002
min1772.424-1772.388=0.036
max1773.136-1773.106=0.030
mean760.000
σ0.000
min760.000
max760.000
mean2644.000-2651.000=-7.000
σ0.000
min2644.000-2651.000=-7.000
max2644.000-2651.000=-7.000
mean2.741-2.739=0.002
σ0.013-0.011=0.002
min2.723-2.728=-0.005
max2.751-2.750=0.001
policies=200
mean17732.585-17732.915=-0.330
σ0.777-0.401=0.376
min17731.759-17732.577=-0.818
max17733.528-17733.492=0.036
mean7600.000
σ0.000
min7600.000
max7600.000
mean2644.000-2651.000=-7.000
σ0.000
min2644.000-2651.000=-7.000
max2644.000-2651.000=-7.000
mean27.670-27.752=-0.082
σ0.160-0.117=0.043
min27.493-27.633=-0.140
max27.883-27.898=-0.016