Compare commits

Home / Compare 9f09feb3 .. d55d69a9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.804-35.979=-0.175
σ0.107-0.106=0.000
min35.753-35.932=-0.179
max36.106-36.280=-0.174
mean414.800-411.000=3.800
σ0.422-0.000=0.422
min414.000-411.000=3.000
max415.000-411.000=4.000
mean0.076-0.077=-0.001
σ0.004-0.004=-0.000
min0.073-0.074=-0.002
max0.083-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.209=-0.145
σ0.004-0.003=0.001
min26.059-26.205=-0.146
max26.072-26.214=-0.141
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.059-0.061=-0.002
σ0.003-0.003=0.000
min0.056-0.059=-0.003
max0.066-0.070=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.925-1758.377=-2.452
σ0.365-0.370=-0.005
min1755.347-1757.799=-2.452
max1756.516-1758.975=-2.459
mean1659.100-1653.550=5.550
σ630.037-625.319=4.718
min624.000-667.000=-43.000
max2694.000-2596.000=98.000
mean2.862-2.352=0.511
σ0.191-0.078=0.113
min2.269-2.278=-0.010
max3.204-2.605=0.599

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-279.543=-2.346
σ0.006-0.007=-0.001
min277.190-279.534=-2.344
max277.206-279.553=-2.347
mean2694.000-2596.000=98.000
σ0.000
min2694.000-2596.000=98.000
max2694.000-2596.000=98.000
mean0.404-0.418=-0.014
σ0.010-0.014=-0.004
min0.399-0.405=-0.007
max0.422-0.438=-0.015
iters=5
new-facts=1
prior-facts=6402
mean2174.447-2178.470=-4.023
σ0.021-0.013=0.008
min2174.429-2178.452=-4.023
max2174.471-2178.488=-4.017
mean2694.000-2596.000=98.000
σ0.000
min2694.000-2596.000=98.000
max2694.000-2596.000=98.000
mean2.955-3.325=-0.370
σ0.109-0.150=-0.041
min2.784-3.205=-0.421
max3.055-3.584=-0.529
iters=5
new-facts=6402
prior-facts=1
mean5052.406-5056.337=-3.931
σ1.137-1.016=0.121
min5051.639-5055.364=-3.724
max5054.421-5058.063=-3.642
mean2694.000-2596.000=98.000
σ0.000
min2694.000-2596.000=98.000
max2694.000-2596.000=98.000
mean9.027-8.998=0.029
σ0.829-0.706=0.123
min8.064-8.105=-0.041
max9.889-9.990=-0.102
iters=5
new-facts=6402
prior-facts=6402
mean5188.421-5193.765=-5.343
σ0.085-0.072=0.013
min5188.353-5193.720=-5.366
max5188.517-5193.893=-5.375
mean3232.000-3221.800=10.200
σ384.930-487.184=-102.255
min2695.000-2601.000=94.000
max3716.000-3830.000=-114.000
mean8.965-8.763=0.202
σ0.422-0.168=0.254
min8.671-8.636=0.036
max9.684-8.957=0.727

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.071-1.261=-0.191
σ0.140-0.356=-0.217
min0.953-0.973=-0.020
max1.295-1.854=-0.559

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.270-465.950=-0.680
σ573.484-573.491=-0.007
min178.521-179.200=-0.678
max1325.495-1326.186=-0.691
mean79.500
σ7.000
min76.000
max90.000
mean2694.000-2596.000=98.000
σ0.000
min2694.000-2596.000=98.000
max2694.000-2596.000=98.000
mean0.538-0.555=-0.017
σ0.521-0.547=-0.026
min0.275-0.279=-0.003
max1.319-1.376=-0.057
policies=20
mean1785.486-1792.266=-6.780
σ0.356-0.348=0.008
min1785.254-1792.024=-6.770
max1786.016-1792.777=-6.761
mean760.000
σ0.000
min760.000
max760.000
mean2694.000-2596.000=98.000
σ0.000
min2694.000-2596.000=98.000
max2694.000-2596.000=98.000
mean2.781-2.821=-0.041
σ0.010-0.053=-0.043
min2.767-2.776=-0.010
max2.788-2.886=-0.098
policies=200
mean17861.522-17929.377=-67.855
σ0.512-0.563=-0.050
min17861.223-17929.087=-67.864
max17862.288-17930.220=-67.933
mean7600.000
σ0.000
min7600.000
max7600.000
mean2694.000-2596.000=98.000
σ0.000
min2694.000-2596.000=98.000
max2694.000-2596.000=98.000
mean28.173-28.280=-0.107
σ0.178-0.182=-0.004
min28.011-28.127=-0.116
max28.397-28.500=-0.103