Compare commits

Home / Compare 4ee55bfd .. a94ff9d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-35.794=-5.024
σ0.051-0.108=-0.057
min30.736-35.740=-5.004
max30.913-36.099=-5.186
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.076-0.076=-0.000
σ0.005-0.004=0.001
min0.070-0.073=-0.003
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-26.064=-5.002
σ0.003-0.004=-0.002
min21.058-26.056=-4.998
max21.065-26.069=-5.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.060=0.004
σ0.002-0.003=-0.001
min0.062-0.056=0.005
max0.069-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.421-1756.107=-4.686
σ0.365-0.366=-0.001
min1750.848-1755.537=-4.689
max1752.014-1756.698=-4.684
mean1645.150-1657.800=-12.650
σ618.377-631.468=-13.091
min674.000-668.000=6.000
max2634.000-2608.000=26.000
mean2.761-2.794=-0.033
σ0.246-0.216=0.029
min2.269-2.211=0.058
max3.196-3.153=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.760-277.387=-1.627
σ0.005-0.005=0.001
min275.752-277.380=-1.627
max275.765-277.392=-1.627
mean2634.000-2608.000=26.000
σ0.000
min2634.000-2608.000=26.000
max2634.000-2608.000=26.000
mean0.394-0.396=-0.002
σ0.009-0.007=0.002
min0.386-0.392=-0.007
max0.405-0.408=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.296-2174.629=-6.333
σ0.005-0.025=-0.020
min2168.289-2174.606=-6.318
max2168.301-2174.672=-6.371
mean2634.000-2608.000=26.000
σ0.000
min2634.000-2608.000=26.000
max2634.000-2608.000=26.000
mean3.045-2.851=0.194
σ0.277-0.170=0.107
min2.778-2.760=0.018
max3.473-3.154=0.319
iters=5
new-facts=6402
prior-facts=1
mean5047.976-5052.588=-4.611
σ1.027-0.417=0.610
min5047.157-5052.300=-5.142
max5049.769-5053.316=-3.547
mean2634.000-2608.000=26.000
σ0.000
min2634.000-2608.000=26.000
max2634.000-2608.000=26.000
mean8.735-8.571=0.164
σ0.440-0.633=-0.193
min8.034-8.041=-0.008
max9.128-9.636=-0.509
iters=5
new-facts=6402
prior-facts=6402
mean5179.246-5188.608=-9.362
σ0.087-0.091=-0.004
min5179.162-5188.533=-9.371
max5179.352-5188.712=-9.360
mean3221.200-3226.800=-5.600
σ385.864-536.736=-150.873
min2681.000-2608.000=73.000
max3704.000-3984.000=-280.000
mean10.029-8.757=1.272
σ0.337-0.221=0.116
min9.485-8.609=0.876
max10.331-9.147=1.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.153-1.333=-0.180
σ0.183-0.416=-0.234
min0.945-0.940=0.005
max1.410-1.833=-0.423

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.578-465.225=-1.648
σ572.674-572.662=0.012
min177.237-178.891=-1.655
max1322.589-1324.219=-1.629
mean79.750-81.750=-2.000
σ7.500
min76.000-78.000=-2.000
max91.000-93.000=-2.000
mean2634.000-2608.000=26.000
σ0.000
min2634.000-2608.000=26.000
max2634.000-2608.000=26.000
mean0.536-0.542=-0.006
σ0.506-0.519=-0.013
min0.277-0.280=-0.003
max1.294-1.320=-0.026
policies=20
mean1772.638-1789.147=-16.509
σ0.338-0.365=-0.027
min1772.399-1788.936=-16.537
max1773.139-1789.692=-16.553
mean760.000-780.000=-20.000
σ0.000
min760.000-780.000=-20.000
max760.000-780.000=-20.000
mean2634.000-2608.000=26.000
σ0.000
min2634.000-2608.000=26.000
max2634.000-2608.000=26.000
mean2.740-2.800=-0.060
σ0.017-0.021=-0.004
min2.714-2.772=-0.058
max2.753-2.821=-0.068
policies=200
mean17732.878-17898.246=-165.368
σ0.612-0.405=0.208
min17732.525-17898.017=-165.493
max17733.795-17898.852=-165.057
mean7600.000-7800.000=-200.000
σ0.000
min7600.000-7800.000=-200.000
max7600.000-7800.000=-200.000
mean2634.000-2608.000=26.000
σ0.000
min2634.000-2608.000=26.000
max2634.000-2608.000=26.000
mean27.752-28.324=-0.572
σ0.176-0.095=0.081
min27.591-28.192=-0.601
max27.989-28.417=-0.428