Compare commits

Home / Compare 5e3899c0 .. c1b7043b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.731=0.049
σ0.052-0.050=0.002
min70.742-70.704=0.039
max70.924-70.871=0.054
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.161-0.162=-0.002
σ0.003-0.005=-0.001
min0.155-0.154=0.001
max0.167-0.173=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.491-21.446=0.045
σ0.002-0.002=0.000
min21.489-21.443=0.046
max21.495-21.448=0.047
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.063-0.067=-0.004
σ0.003-0.003=0.000
min0.060-0.065=-0.004
max0.070-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1755.285=-3.404
σ0.361-0.359=0.002
min1751.317-1754.717=-3.400
max1752.474-1755.865=-3.390
mean1643.250-1625.350=17.900
σ629.052-595.382=33.670
min623.000-636.000=-13.000
max2773.000-2420.000=353.000
mean2.840-2.836=0.004
σ0.145-0.191=-0.045
min2.604-2.183=0.422
max3.165-3.075=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.379-272.766=-3.386
σ0.005-0.004=0.002
min269.372-272.760=-3.388
max269.386-272.768=-3.383
mean2773.000-2420.000=353.000
σ0.000
min2773.000-2420.000=353.000
max2773.000-2420.000=353.000
mean0.378-0.384=-0.006
σ0.006-0.004=0.001
min0.375-0.379=-0.004
max0.388-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1929.752-1933.150=-3.397
σ0.006-0.017=-0.012
min1929.746-1933.128=-3.382
max1929.759-1933.175=-3.416
mean2773.000-2420.000=353.000
σ0.000
min2773.000-2420.000=353.000
max2773.000-2420.000=353.000
mean3.071-3.148=-0.077
σ0.084-0.150=-0.066
min2.983-3.011=-0.028
max3.164-3.379=-0.215
iters=5
new-facts=6402
prior-facts=1
mean4750.496-4753.770=-3.273
σ0.879-0.939=-0.061
min4750.076-4752.884=-2.808
max4752.068-4755.370=-3.302
mean2773.000-2420.000=353.000
σ0.000
min2773.000-2420.000=353.000
max2773.000-2420.000=353.000
mean8.549-8.545=0.004
σ0.339-0.463=-0.124
min8.008-7.866=0.142
max8.903-9.003=-0.100
iters=5
new-facts=6402
prior-facts=6402
mean4940.988-4944.313=-3.325
σ0.014-0.161=-0.148
min4940.971-4944.025=-3.054
max4941.002-4944.403=-3.401
mean2998.000-2905.200=92.800
σ220.292-408.825=-188.534
min2773.000-2434.000=339.000
max3318.000-3461.000=-143.000
mean8.517-8.451=0.065
σ0.143-0.149=-0.007
min8.332-8.345=-0.013
max8.705-8.714=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.021-1.752=-0.730
σ0.140-0.020=0.120
min0.926-1.725=-0.798
max1.249-1.774=-0.525

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.712-472.829=-10.117
σ574.963-574.922=0.041
min175.223-185.365=-10.142
max1325.156-1335.212=-10.056
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2773.000-2420.000=353.000
σ0.000
min2773.000-2420.000=353.000
max2773.000-2420.000=353.000
mean0.559-0.563=-0.004
σ0.567-0.523=0.044
min0.275-0.296=-0.021
max1.410-1.348=0.062
policies=20
mean1752.468-1853.939=-101.471
σ0.299-0.372=-0.073
min1752.264-1853.673=-101.410
max1752.912-1854.486=-101.574
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2773.000-2420.000=353.000
σ0.000
min2773.000-2420.000=353.000
max2773.000-2420.000=353.000
mean2.726-2.864=-0.138
σ0.002-0.025=-0.023
min2.724-2.827=-0.103
max2.729-2.883=-0.153
policies=200
mean17532.279-18546.113=-1013.834
σ0.531-0.920=-0.389
min17531.872-18545.361=-1013.489
max17533.058-18547.270=-1014.211
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2773.000-2420.000=353.000
σ0.000
min2773.000-2420.000=353.000
max2773.000-2420.000=353.000
mean27.537-28.954=-1.417
σ0.111-0.108=0.003
min27.436-28.841=-1.405
max27.690-29.101=-1.412