Compare commits

Home / Compare eb604acc .. c430c4c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.397-70.389=0.008
σ0.045-0.049=-0.004
min70.370-70.360=0.010
max70.522-70.526=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.159-0.158=0.001
σ0.003-0.002=0.001
min0.156-0.155=0.001
max0.166-0.163=0.003
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.000
σ0.003-0.003=-0.000
min21.141-21.140=0.000
max21.149-21.151=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.001
min0.060-0.062=-0.002
max0.072-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.392-1752.391=0.000
σ0.363-0.361=0.002
min1751.827-1751.827=0.001
max1752.980-1752.977=0.004
mean1655.000-1665.250=-10.250
σ628.638-622.992=5.646
min619.000-636.000=-17.000
max2770.000-2504.000=266.000
mean2.839-2.771=0.068
σ0.205-0.200=0.005
min2.391-2.367=0.024
max3.379-3.199=0.180

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.237-270.143=0.094
σ0.007-0.007=0.000
min270.231-270.137=0.094
max270.247-270.152=0.096
mean2770.000-2504.000=266.000
σ0.000
min2770.000-2504.000=266.000
max2770.000-2504.000=266.000
mean0.379-0.377=0.002
σ0.006-0.005=0.001
min0.370-0.369=0.001
max0.387-0.384=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.704-1930.599=0.105
σ0.005-0.004=0.001
min1930.696-1930.592=0.104
max1930.710-1930.604=0.106
mean2770.000-2504.000=266.000
σ0.000
min2770.000-2504.000=266.000
max2770.000-2504.000=266.000
mean2.535-2.641=-0.106
σ0.093-0.126=-0.032
min2.454-2.429=0.025
max2.662-2.753=-0.092
iters=5
new-facts=6402
prior-facts=1
mean4751.414-4751.074=0.340
σ0.831-1.095=-0.263
min4750.900-4750.270=0.630
max4752.890-4752.929=-0.038
mean2770.000-2504.000=266.000
σ0.000
min2770.000-2504.000=266.000
max2770.000-2504.000=266.000
mean8.464-8.780=-0.315
σ0.443-0.375=0.069
min7.784-8.125=-0.341
max8.994-9.034=-0.040
iters=5
new-facts=6402
prior-facts=6402
mean4941.867-4941.775=0.092
σ0.022-0.032=-0.010
min4941.840-4941.735=0.105
max4941.895-4941.821=0.074
mean3048.800-2970.000=78.800
σ211.984-338.956=-126.973
min2770.000-2504.000=266.000
max3328.000-3290.000=38.000
mean8.610-8.858=-0.248
σ0.192-0.439=-0.246
min8.420-8.397=0.022
max8.830-9.517=-0.687

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.715=-0.660
σ0.191-0.189=0.002
min0.937-1.384=-0.447
max1.381-1.828=-0.447

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.756-466.369=0.388
σ575.936-575.929=0.007
min178.781-178.402=0.379
max1330.660-1330.262=0.399
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2770.000-2504.000=266.000
σ0.000
min2770.000-2504.000=266.000
max2770.000-2504.000=266.000
mean0.446-0.551=-0.105
σ0.307-0.539=-0.231
min0.290-0.278=0.012
max0.907-1.359=-0.452
policies=20
mean1788.112-1784.319=3.794
σ0.340-0.348=-0.008
min1787.853-1784.099=3.754
max1788.602-1784.837=3.765
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2770.000-2504.000=266.000
σ0.000
min2770.000-2504.000=266.000
max2770.000-2504.000=266.000
mean2.844-2.771=0.074
σ0.101-0.018=0.083
min2.785-2.758=0.027
max2.995-2.797=0.199
policies=200
mean17888.166-17849.877=38.289
σ0.511-0.459=0.051
min17887.884-17849.546=38.338
max17888.932-17850.554=38.377
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2770.000-2504.000=266.000
σ0.000
min2770.000-2504.000=266.000
max2770.000-2504.000=266.000
mean28.140-27.840=0.300
σ0.077-0.032=0.044
min28.032-27.800=0.232
max28.210-27.872=0.338