Compare commits

Home / Compare a94ff9d1 .. f9a6f0a0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.794-30.770=5.024
σ0.108-0.051=0.057
min35.740-30.736=5.004
max36.099-30.913=5.186
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.076-0.076=0.000
σ0.004-0.005=-0.001
min0.073-0.070=0.003
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-21.061=5.002
σ0.004-0.003=0.002
min26.056-21.058=4.998
max26.069-21.065=5.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.063=-0.004
σ0.003-0.002=0.001
min0.056-0.062=-0.005
max0.068-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.107-1751.421=4.686
σ0.366-0.365=0.001
min1755.537-1750.848=4.689
max1756.698-1752.014=4.684
mean1657.800-1645.150=12.650
σ631.468-618.377=13.091
min668.000-674.000=-6.000
max2608.000-2634.000=-26.000
mean2.794-2.761=0.033
σ0.216-0.246=-0.029
min2.211-2.269=-0.058
max3.153-3.196=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.387-275.760=1.627
σ0.005-0.005=-0.001
min277.380-275.752=1.627
max277.392-275.765=1.627
mean2608.000-2634.000=-26.000
σ0.000
min2608.000-2634.000=-26.000
max2608.000-2634.000=-26.000
mean0.396-0.394=0.002
σ0.007-0.009=-0.002
min0.392-0.386=0.007
max0.408-0.405=0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.629-2168.296=6.333
σ0.025-0.005=0.020
min2174.606-2168.289=6.318
max2174.672-2168.301=6.371
mean2608.000-2634.000=-26.000
σ0.000
min2608.000-2634.000=-26.000
max2608.000-2634.000=-26.000
mean2.851-3.045=-0.194
σ0.170-0.277=-0.107
min2.760-2.778=-0.018
max3.154-3.473=-0.319
iters=5
new-facts=6402
prior-facts=1
mean5052.588-5047.976=4.611
σ0.417-1.027=-0.610
min5052.300-5047.157=5.142
max5053.316-5049.769=3.547
mean2608.000-2634.000=-26.000
σ0.000
min2608.000-2634.000=-26.000
max2608.000-2634.000=-26.000
mean8.571-8.735=-0.164
σ0.633-0.440=0.193
min8.041-8.034=0.008
max9.636-9.128=0.509
iters=5
new-facts=6402
prior-facts=6402
mean5188.608-5179.246=9.362
σ0.091-0.087=0.004
min5188.533-5179.162=9.371
max5188.712-5179.352=9.360
mean3226.800-3221.200=5.600
σ536.736-385.864=150.873
min2608.000-2681.000=-73.000
max3984.000-3704.000=280.000
mean8.757-10.029=-1.272
σ0.221-0.337=-0.116
min8.609-9.485=-0.876
max9.147-10.331=-1.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.333-1.153=0.180
σ0.416-0.183=0.234
min0.940-0.945=-0.005
max1.833-1.410=0.423

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.225-463.578=1.648
σ572.662-572.674=-0.012
min178.891-177.237=1.655
max1324.219-1322.589=1.629
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2608.000-2634.000=-26.000
σ0.000
min2608.000-2634.000=-26.000
max2608.000-2634.000=-26.000
mean0.542-0.536=0.006
σ0.519-0.506=0.013
min0.280-0.277=0.003
max1.320-1.294=0.026
policies=20
mean1789.147-1772.638=16.509
σ0.365-0.338=0.027
min1788.936-1772.399=16.537
max1789.692-1773.139=16.553
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2608.000-2634.000=-26.000
σ0.000
min2608.000-2634.000=-26.000
max2608.000-2634.000=-26.000
mean2.800-2.740=0.060
σ0.021-0.017=0.004
min2.772-2.714=0.058
max2.821-2.753=0.068
policies=200
mean17898.246-17732.878=165.368
σ0.405-0.612=-0.208
min17898.017-17732.525=165.493
max17898.852-17733.795=165.057
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2608.000-2634.000=-26.000
σ0.000
min2608.000-2634.000=-26.000
max2608.000-2634.000=-26.000
mean28.324-27.752=0.572
σ0.095-0.176=-0.081
min28.192-27.591=0.601
max28.417-27.989=0.428