Compare commits

Home / Compare fdd09c04 .. f9d7c215

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.770=-0.002
σ0.051-0.051=0.000
min30.744-30.741=0.004
max30.913-30.914=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.077-0.079=-0.002
σ0.005-0.004=0.001
min0.070-0.076=-0.006
max0.083-0.086=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.003-0.002=0.000
min21.057-21.058=-0.001
max21.065-21.064=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.063=-0.000
σ0.003-0.004=-0.001
min0.058-0.058=-0.000
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.237=-0.000
σ0.362-0.362=-0.000
min1750.666-1750.670=-0.004
max1751.818-1751.826=-0.008
mean1658.000-1641.700=16.300
σ645.520-617.707=27.813
min630.000-628.000=2.000
max2850.000-2479.000=371.000
mean2.829-2.845=-0.016
σ0.139-0.120=0.019
min2.523-2.542=-0.019
max3.008-3.024=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.571-275.568=0.003
σ0.009-0.007=0.002
min275.557-275.556=0.001
max275.583-275.573=0.010
mean2850.000-2479.000=371.000
σ0.000
min2850.000-2479.000=371.000
max2850.000-2479.000=371.000
mean0.397-0.405=-0.008
σ0.008-0.008=-0.000
min0.392-0.398=-0.006
max0.412-0.415=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.100-2168.084=0.016
σ0.007-0.018=-0.011
min2168.091-2168.061=0.030
max2168.107-2168.101=0.006
mean2850.000-2479.000=371.000
σ0.000
min2850.000-2479.000=371.000
max2850.000-2479.000=371.000
mean2.973-2.988=-0.015
σ0.178-0.257=-0.079
min2.737-2.648=0.089
max3.146-3.342=-0.197
iters=5
new-facts=6402
prior-facts=1
mean5047.790-5047.907=-0.118
σ0.601-0.911=-0.310
min5047.353-5047.344=0.009
max5048.830-5049.528=-0.698
mean2850.000-2479.000=371.000
σ0.000
min2850.000-2479.000=371.000
max2850.000-2479.000=371.000
mean8.729-8.783=-0.054
σ0.464-0.490=-0.026
min8.052-8.015=0.037
max9.312-9.243=0.069
iters=5
new-facts=6402
prior-facts=6402
mean5179.050-5178.981=0.068
σ0.086-0.129=-0.043
min5178.971-5178.796=0.175
max5179.158-5179.153=0.005
mean3251.800-3209.400=42.400
σ332.391-347.745=-15.354
min2850.000-2716.000=134.000
max3700.000-3633.000=67.000
mean9.863-9.900=-0.037
σ0.330-0.329=0.001
min9.352-9.546=-0.194
max10.168-10.213=-0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.061-1.636=-0.574
σ0.132-0.131=0.002
min0.931-1.477=-0.546
max1.260-1.780=-0.520

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.200=0.003
σ572.652-572.652=0.000
min176.874-176.870=0.004
max1322.182-1322.178=0.003
mean77.500
σ7.000
min74.000
max88.000
mean2850.000-2479.000=371.000
σ0.000
min2850.000-2479.000=371.000
max2850.000-2479.000=371.000
mean0.440-0.545=-0.105
σ0.304-0.530=-0.226
min0.286-0.278=0.008
max0.896-1.340=-0.444
policies=20
mean1769.002-1768.962=0.040
σ0.334-0.316=0.018
min1768.771-1768.757=0.014
max1769.496-1769.432=0.063
mean740.000
σ0.000
min740.000
max740.000
mean2850.000-2479.000=371.000
σ0.000
min2850.000-2479.000=371.000
max2850.000-2479.000=371.000
mean2.822-2.749=0.074
σ0.023-0.032=-0.009
min2.806-2.726=0.079
max2.856-2.796=0.060
policies=200
mean17696.286-17696.155=0.131
σ0.491-0.601=-0.110
min17695.917-17695.785=0.132
max17697.005-17697.046=-0.042
mean7400.000
σ0.000
min7400.000
max7400.000
mean2850.000-2479.000=371.000
σ0.000
min2850.000-2479.000=371.000
max2850.000-2479.000=371.000
mean28.036-27.865=0.171
σ0.509-0.221=0.288
min27.540-27.710=-0.170
max28.569-28.186=0.383