Compare commits

Home / Compare 50aa1e60 .. 85924b9e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=0.000
σ0.046-0.046=0.000
min30.736-30.726=0.011
max30.898-30.895=0.002
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.073-0.076=-0.003
σ0.004-0.005=-0.001
min0.069-0.070=-0.001
max0.078-0.086=-0.008
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.003-0.004=-0.001
min21.054-21.054=0.000
max21.065-21.066=-0.001
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.063-0.061=0.002
σ0.002-0.004=-0.002
min0.062-0.057=0.005
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.422-1751.421=0.001
σ0.362-0.361=0.001
min1750.845-1750.846=-0.002
max1752.002-1752.000=0.002
mean1651.600-1658.000=-6.400
σ624.599-631.218=-6.619
min692.000-678.000=14.000
max2812.000-2686.000=126.000
mean2.808-2.858=-0.050
σ0.157-0.120=0.037
min2.345-2.495=-0.150
max3.039-3.000=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.759-275.755=0.003
σ0.009-0.008=0.001
min275.746-275.744=0.002
max275.768-275.764=0.003
mean2812.000-2686.000=126.000
σ0.000
min2812.000-2686.000=126.000
max2812.000-2686.000=126.000
mean0.406-0.397=0.008
σ0.011-0.003=0.008
min0.396-0.395=0.001
max0.419-0.403=0.016
iters=5
new-facts=1
prior-facts=6402
mean2168.275-2168.276=-0.001
σ0.014-0.012=0.002
min2168.251-2168.258=-0.007
max2168.286-2168.291=-0.004
mean2812.000-2686.000=126.000
σ0.000
min2812.000-2686.000=126.000
max2812.000-2686.000=126.000
mean2.999-2.942=0.057
σ0.167-0.102=0.065
min2.791-2.805=-0.014
max3.128-3.035=0.092
iters=5
new-facts=6402
prior-facts=1
mean5048.142-5047.988=0.154
σ0.912-0.728=0.184
min5047.552-5047.598=-0.046
max5049.758-5049.285=0.473
mean2812.000-2686.000=126.000
σ0.000
min2812.000-2686.000=126.000
max2812.000-2686.000=126.000
mean8.834-8.901=-0.067
σ0.680-0.588=0.092
min8.060-8.078=-0.018
max9.756-9.735=0.021
iters=5
new-facts=6402
prior-facts=6402
mean5179.022-5179.166=-0.145
σ0.336-0.134=0.203
min5178.463-5178.963=-0.501
max5179.294-5179.339=-0.045
mean3245.400-3266.400=-21.000
σ349.437-379.126=-29.689
min2812.000-2730.000=82.000
max3724.000-3723.000=1.000
mean9.681-9.951=-0.271
σ0.675-0.259=0.416
min8.660-9.576=-0.916
max10.395-10.268=0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.110-1.195=-0.085
σ0.151-0.228=-0.077
min0.949-0.942=0.007
max1.361-1.402=-0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-463.574=0.004
σ572.659-572.666=-0.007
min177.239-177.237=0.002
max1322.566-1322.572=-0.006
mean79.750
σ7.500
min76.000
max91.000
mean2812.000-2686.000=126.000
σ0.000
min2812.000-2686.000=126.000
max2812.000-2686.000=126.000
mean0.438-0.555=-0.117
σ0.308-0.554=-0.245
min0.282-0.275=0.007
max0.901-1.385=-0.484
policies=20
mean1772.679-1772.643=0.036
σ0.324-0.331=-0.006
min1772.427-1772.421=0.006
max1773.149-1773.134=0.015
mean760.000
σ0.000
min760.000
max760.000
mean2812.000-2686.000=126.000
σ0.000
min2812.000-2686.000=126.000
max2812.000-2686.000=126.000
mean2.846-2.757=0.090
σ0.100-0.032=0.068
min2.738-2.728=0.010
max2.981-2.802=0.179
policies=200
mean17733.015-17732.913=0.103
σ0.463-0.571=-0.108
min17732.707-17732.496=0.211
max17733.705-17733.758=-0.053
mean7600.000
σ0.000
min7600.000
max7600.000
mean2812.000-2686.000=126.000
σ0.000
min2812.000-2686.000=126.000
max2812.000-2686.000=126.000
mean27.741-27.729=0.012
σ0.148-0.164=-0.016
min27.606-27.625=-0.020
max27.947-27.972=-0.025