Compare commits

Home / Compare 68b3875a .. 63c40570

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.377=0.002
σ0.047-0.058=-0.011
min70.355-70.343=0.012
max70.512-70.541=-0.029
mean414.000
σ0.000
min414.000
max414.000
mean0.159-0.165=-0.006
σ0.003-0.009=-0.006
min0.157-0.157=0.000
max0.164-0.180=-0.016
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.002
σ0.002-0.003=-0.001
min21.142-21.137=0.005
max21.148-21.147=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.065=-0.001
σ0.003-0.002=0.001
min0.059-0.062=-0.003
max0.071-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1714.294=38.093
σ0.361-169.626=-169.265
min1751.815-993.635=758.180
max1752.966-1752.782=0.183
mean1661.050-1600.350=60.700
σ622.128-622.892=-0.764
min637.000-615.000=22.000
max2507.000-2745.000=-238.000
mean2.759-2.740=0.019
σ0.239-0.347=-0.108
min2.164-1.477=0.687
max3.082-3.145=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-269.932=0.194
σ0.005-0.008=-0.003
min270.118-269.925=0.193
max270.133-269.947=0.186
mean2507.000-2745.000=-238.000
σ0.000
min2507.000-2745.000=-238.000
max2507.000-2745.000=-238.000
mean0.373-0.378=-0.005
σ0.004-0.013=-0.009
min0.369-0.369=0.001
max0.379-0.401=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1930.596-1930.390=0.206
σ0.016-0.017=-0.001
min1930.572-1930.370=0.202
max1930.612-1930.405=0.207
mean2507.000-2745.000=-238.000
σ0.000
min2507.000-2745.000=-238.000
max2507.000-2745.000=-238.000
mean2.581-2.560=0.021
σ0.155-0.165=-0.010
min2.444-2.404=0.040
max2.810-2.800=0.010
iters=5
new-facts=6402
prior-facts=1
mean4750.887-4750.908=-0.021
σ0.315-0.781=-0.466
min4750.684-4750.379=0.305
max4751.445-4752.287=-0.842
mean2507.000-2745.000=-238.000
σ0.000
min2507.000-2745.000=-238.000
max2507.000-2745.000=-238.000
mean8.346-8.132=0.214
σ0.525-0.491=0.034
min7.786-7.673=0.112
max8.955-8.798=0.157
iters=5
new-facts=6402
prior-facts=6402
mean4941.453-4941.335=0.118
σ0.215-0.076=0.139
min4941.097-4941.261=-0.164
max4941.636-4941.426=0.210
mean2931.200-3039.600=-108.400
σ384.586-352.832=31.755
min2507.000-2745.000=-238.000
max3430.000-3560.000=-130.000
mean8.461-8.530=-0.069
σ0.354-0.413=-0.059
min8.241-8.251=-0.010
max9.090-9.260=-0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.714-1.083=0.630
σ0.128-0.110=0.018
min1.577-0.941=0.637
max1.862-1.250=0.612

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.356-465.924=0.431
σ575.918-575.800=0.118
min178.392-178.021=0.372
max1330.233-1329.624=0.609
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2507.000-2745.000=-238.000
σ0.000
min2507.000-2745.000=-238.000
max2507.000-2745.000=-238.000
mean0.565-0.489=0.075
σ0.563-0.420=0.142
min0.278-0.277=0.000
max1.409-1.120=0.289
policies=20
mean1784.221-1780.467=3.754
σ0.351-0.352=-0.001
min1783.995-1780.241=3.754
max1784.744-1780.990=3.754
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2507.000-2745.000=-238.000
σ0.000
min2507.000-2745.000=-238.000
max2507.000-2745.000=-238.000
mean2.773-2.783=-0.011
σ0.024-0.013=0.012
min2.746-2.772=-0.026
max2.794-2.798=-0.004
policies=200
mean17848.920-17811.430=37.490
σ0.467-0.478=-0.010
min17848.617-17811.034=37.583
max17849.617-17812.118=37.499
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2507.000-2745.000=-238.000
σ0.000
min2507.000-2745.000=-238.000
max2507.000-2745.000=-238.000
mean27.854-27.958=-0.104
σ0.131-0.122=0.009
min27.746-27.858=-0.112
max28.045-28.136=-0.091