Compare commits

Home / Compare 3b2b8724 .. d1f3f605

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.855-35.882=-5.027
σ0.046-0.107=-0.062
min30.832-35.833=-5.002
max30.983-36.186=-5.203
mean414.000-410.000=4.000
σ0.000
min414.000-410.000=4.000
max414.000-410.000=4.000
mean0.079-0.078=0.000
σ0.004-0.004=0.000
min0.072-0.074=-0.002
max0.087-0.085=0.002
cache=y
dps=1
iters=10
policies=100
mean21.142-26.147=-5.006
σ0.004-0.006=-0.002
min21.136-26.140=-5.004
max21.151-26.157=-5.007
mean414.000-410.000=4.000
σ0.000
min414.000-410.000=4.000
max414.000-410.000=4.000
mean0.064-0.062=0.002
σ0.004-0.003=0.001
min0.057-0.060=-0.003
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1755.923=-4.688
σ0.361-0.363=-0.002
min1750.667-1755.347=-4.681
max1751.818-1756.501=-4.683
mean1668.000-1641.000=27.000
σ639.191-626.361=12.830
min681.000-607.000=74.000
max2698.000-2772.000=-74.000
mean2.794-2.826=-0.032
σ0.151-0.155=-0.003
min2.401-2.438=-0.037
max2.998-2.988=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.564-277.198=-1.634
σ0.007-0.004=0.003
min275.557-277.194=-1.637
max275.575-277.203=-1.628
mean2698.000-2772.000=-74.000
σ0.000
min2698.000-2772.000=-74.000
max2698.000-2772.000=-74.000
mean0.393-0.407=-0.013
σ0.009-0.008=0.001
min0.386-0.399=-0.014
max0.403-0.416=-0.013
iters=5
new-facts=1
prior-facts=6402
mean2168.097-2174.418=-6.321
σ0.008-0.014=-0.006
min2168.086-2174.399=-6.313
max2168.108-2174.431=-6.323
mean2698.000-2772.000=-74.000
σ0.000
min2698.000-2772.000=-74.000
max2698.000-2772.000=-74.000
mean2.987-3.044=-0.057
σ0.154-0.254=-0.100
min2.790-2.728=0.062
max3.137-3.428=-0.291
iters=5
new-facts=6402
prior-facts=1
mean5047.899-5052.599=-4.700
σ0.914-0.921=-0.007
min5047.400-5051.996=-4.596
max5049.529-5054.233=-4.705
mean2698.000-2772.000=-74.000
σ0.000
min2698.000-2772.000=-74.000
max2698.000-2772.000=-74.000
mean8.898-8.714=0.184
σ0.456-0.511=-0.056
min8.173-8.106=0.067
max9.318-9.284=0.034
iters=5
new-facts=6402
prior-facts=6402
mean5179.055-5188.354=-9.299
σ0.082-0.210=-0.128
min5178.971-5188.006=-9.035
max5179.147-5188.527=-9.380
mean3234.200-3249.800=-15.600
σ395.427-343.121=52.306
min2698.000-2772.000=-74.000
max3742.000-3697.000=45.000
mean10.214-8.957=1.258
σ0.649-0.227=0.421
min9.680-8.686=0.994
max11.343-9.257=2.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-1.179=-0.122
σ0.149-0.200=-0.051
min0.947-0.999=-0.051
max1.248-1.470=-0.222

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-464.873=-1.667
σ572.658-572.680=-0.023
min176.867-178.523=-1.657
max1322.192-1323.893=-1.701
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2698.000-2772.000=-74.000
σ0.000
min2698.000-2772.000=-74.000
max2698.000-2772.000=-74.000
mean0.547-0.584=-0.038
σ0.549-0.597=-0.048
min0.271-0.283=-0.013
max1.370-1.480=-0.110
policies=20
mean1768.948-1785.473=-16.525
σ0.339-0.344=-0.005
min1768.726-1785.242=-16.516
max1769.452-1785.984=-16.532
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2698.000-2772.000=-74.000
σ0.000
min2698.000-2772.000=-74.000
max2698.000-2772.000=-74.000
mean2.751-2.794=-0.043
σ0.027-0.021=0.006
min2.725-2.779=-0.053
max2.787-2.825=-0.038
policies=200
mean17696.243-17861.541=-165.298
σ0.534-0.471=0.062
min17695.928-17861.302=-165.374
max17697.039-17862.248=-165.209
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2698.000-2772.000=-74.000
σ0.000
min2698.000-2772.000=-74.000
max2698.000-2772.000=-74.000
mean27.696-28.144=-0.447
σ0.154-0.137=0.017
min27.541-28.017=-0.477
max27.862-28.315=-0.453