Compare commits

Home / Compare 07e4de6b .. ac133fc6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.801-35.801=-0.000
σ0.105-0.108=-0.004
min35.757-35.759=-0.002
max36.098-36.109=-0.011
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.076-0.075=0.001
σ0.004-0.003=0.001
min0.073-0.071=0.001
max0.083-0.081=0.001
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.000
σ0.004-0.004=0.000
min26.058-26.060=-0.002
max26.072-26.071=0.001
mean414.000-413.500=0.500
σ0.000-0.527=-0.527
min414.000-413.000=1.000
max414.000
mean0.059-0.061=-0.003
σ0.003-0.003=-0.000
min0.056-0.059=-0.003
max0.065-0.070=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.268-1754.271=-0.004
σ0.363-0.365=-0.002
min1753.701-1753.701=0.000
max1754.841-1754.844=-0.003
mean1637.950-1638.450=-0.500
σ604.764-617.372=-12.608
min628.000-635.000=-7.000
max2435.000-2476.000=-41.000
mean2.809-2.738=0.071
σ0.126-0.251=-0.126
min2.530-2.171=0.359
max2.960-3.066=-0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.570-275.571=-0.001
σ0.005-0.006=-0.001
min275.565-275.564=0.000
max275.578-275.581=-0.004
mean2435.000-2476.000=-41.000
σ0.000
min2435.000-2476.000=-41.000
max2435.000-2476.000=-41.000
mean0.390-0.400=-0.010
σ0.006-0.006=0.001
min0.384-0.395=-0.011
max0.397-0.408=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2172.839-2172.827=0.012
σ0.004-0.019=-0.015
min2172.834-2172.794=0.040
max2172.844-2172.840=0.004
mean2435.000-2476.000=-41.000
σ0.000
min2435.000-2476.000=-41.000
max2435.000-2476.000=-41.000
mean3.055-2.921=0.135
σ0.214-0.207=0.007
min2.813-2.708=0.106
max3.339-3.248=0.091
iters=5
new-facts=6402
prior-facts=1
mean5050.833-5050.945=-0.111
σ0.976-0.905=0.071
min5050.095-5050.452=-0.357
max5052.548-5052.558=-0.011
mean2435.000-2476.000=-41.000
σ0.000
min2435.000-2476.000=-41.000
max2435.000-2476.000=-41.000
mean8.967-8.912=0.055
σ0.490-0.508=-0.017
min8.314-8.115=0.200
max9.588-9.374=0.214
iters=5
new-facts=6402
prior-facts=6402
mean5186.737-5186.797=-0.060
σ0.202-0.082=0.120
min5186.396-5186.732=-0.335
max5186.886-5186.887=-0.000
mean3207.800-3258.400=-50.600
σ377.324-381.709=-4.385
min2674.000-2724.000=-50.000
max3673.000-3725.000=-52.000
mean9.757-9.711=0.046
σ0.380-0.167=0.213
min9.135-9.594=-0.459
max10.124-10.006=0.118

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.863-1.858=0.005
σ0.059-0.111=-0.052
min1.799-1.673=0.126
max1.949-1.943=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.196-463.196=-0.001
σ572.651-572.650=0.001
min176.868-176.870=-0.002
max1322.172-1322.171=0.001
mean77.500
σ7.000
min74.000
max88.000
mean2435.000-2476.000=-41.000
σ0.000
min2435.000-2476.000=-41.000
max2435.000-2476.000=-41.000
mean0.556-0.535=0.020
σ0.562-0.510=0.051
min0.272-0.276=-0.004
max1.399-1.301=0.098
policies=20
mean1768.949-1768.977=-0.028
σ0.340-0.339=0.001
min1768.738-1768.765=-0.027
max1769.456-1769.482=-0.026
mean740.000
σ0.000
min740.000
max740.000
mean2435.000-2476.000=-41.000
σ0.000
min2435.000-2476.000=-41.000
max2435.000-2476.000=-41.000
mean2.753-2.750=0.003
σ0.025-0.009=0.017
min2.724-2.744=-0.019
max2.775-2.763=0.012
policies=200
mean17696.251-17696.132=0.120
σ0.528-0.619=-0.091
min17695.934-17695.773=0.162
max17697.040-17697.058=-0.018
mean7400.000
σ0.000
min7400.000
max7400.000
mean2435.000-2476.000=-41.000
σ0.000
min2435.000-2476.000=-41.000
max2435.000-2476.000=-41.000
mean27.681-27.611=0.070
σ0.183-0.118=0.065
min27.482-27.469=0.013
max27.888-27.736=0.152