Compare commits

Home / Compare 1648336a .. dd49a894

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.795=-0.001
σ0.106-0.108=-0.003
min35.747-35.752=-0.005
max36.093-36.102=-0.009
mean412.900-413.000=-0.100
σ0.316-0.000=0.316
min412.000-413.000=-1.000
max413.000
mean0.076-0.077=-0.001
σ0.003-0.004=-0.001
min0.074-0.073=0.001
max0.081-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.003=0.000
min26.061-26.060=0.001
max26.073-26.069=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.061-0.058=0.003
σ0.003-0.003=-0.000
min0.059-0.056=0.003
max0.068-0.066=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.238-1751.236=0.001
σ0.362-0.362=-0.000
min1750.677-1750.670=0.007
max1751.825-1751.822=0.003
mean1634.350-1661.300=-26.950
σ616.533-635.382=-18.849
min628.000-620.000=8.000
max2471.000-2779.000=-308.000
mean2.853-2.887=-0.034
σ0.118-0.106=0.012
min2.541-2.655=-0.114
max3.083-3.112=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.569=-0.003
σ0.007-0.006=0.001
min275.559-275.561=-0.002
max275.575-275.575=-0.000
mean2471.000-2779.000=-308.000
σ0.000
min2471.000-2779.000=-308.000
max2471.000-2779.000=-308.000
mean0.395-0.405=-0.010
σ0.009-0.012=-0.004
min0.388-0.395=-0.007
max0.406-0.422=-0.016
iters=5
new-facts=1
prior-facts=6402
mean2168.104-2168.088=0.016
σ0.003-0.014=-0.011
min2168.099-2168.068=0.031
max2168.107-2168.104=0.002
mean2471.000-2779.000=-308.000
σ0.000
min2471.000-2779.000=-308.000
max2471.000-2779.000=-308.000
mean2.959-3.026=-0.067
σ0.151-0.136=0.015
min2.769-2.818=-0.049
max3.153-3.187=-0.034
iters=5
new-facts=6402
prior-facts=1
mean5047.926-5047.934=-0.008
σ0.884-0.897=-0.012
min5047.390-5047.346=0.044
max5049.500-5049.501=-0.002
mean2471.000-2779.000=-308.000
σ0.000
min2471.000-2779.000=-308.000
max2471.000-2779.000=-308.000
mean8.781-9.191=-0.410
σ0.573-0.589=-0.016
min8.069-8.485=-0.416
max9.389-10.020=-0.631
iters=5
new-facts=6402
prior-facts=6402
mean5179.037-5179.055=-0.018
σ0.079-0.084=-0.005
min5178.968-5178.969=-0.002
max5179.124-5179.149=-0.025
mean3219.400-3258.000=-38.600
σ389.498-354.970=34.528
min2684.000-2779.000=-95.000
max3707.000-3703.000=4.000
mean9.788-10.000=-0.212
σ0.198-0.259=-0.061
min9.584-9.577=0.006
max10.061-10.226=-0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.802-1.063=0.739
σ0.123-0.127=-0.004
min1.652-0.945=0.707
max1.989-1.258=0.731

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.197-463.202=-0.004
σ572.647-572.665=-0.018
min176.871-176.863=0.008
max1322.168-1322.199=-0.031
mean77.500
σ7.000
min74.000
max88.000
mean2471.000-2779.000=-308.000
σ0.000
min2471.000-2779.000=-308.000
max2471.000-2779.000=-308.000
mean0.561-0.439=0.122
σ0.559-0.300=0.259
min0.276-0.288=-0.012
max1.400-0.889=0.511
policies=20
mean1768.972-1768.976=-0.004
σ0.344-0.315=0.028
min1768.761-1768.766=-0.005
max1769.485-1769.437=0.048
mean740.000
σ0.000
min740.000
max740.000
mean2471.000-2779.000=-308.000
σ0.000
min2471.000-2779.000=-308.000
max2471.000-2779.000=-308.000
mean2.752-2.794=-0.042
σ0.031-0.126=-0.096
min2.723-2.727=-0.004
max2.796-2.984=-0.188
policies=200
mean17696.159-17695.966=0.192
σ0.404-0.500=-0.097
min17695.863-17695.664=0.199
max17696.753-17696.714=0.039
mean7400.000
σ0.000
min7400.000
max7400.000
mean2471.000-2779.000=-308.000
σ0.000
min2471.000-2779.000=-308.000
max2471.000-2779.000=-308.000
mean27.668-27.715=-0.048
σ0.186-0.081=0.105
min27.461-27.637=-0.177
max27.862-27.820=0.042