Compare commits

Home / Compare ab2768f3 .. 330ab809

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-73.062=-37.817
σ0.053-0.052=0.001
min35.217-73.040=-37.823
max35.394-73.209=-37.815
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.085-0.161=-0.076
σ0.003-0.003=0.000
min0.082-0.157=-0.075
max0.092-0.166=-0.075
cache=y
dps=1
iters=10
policies=100
mean23.769-23.755=0.014
σ0.002-0.003=-0.001
min23.767-23.751=0.015
max23.774-23.759=0.014
mean418.000-414.500=3.500
σ0.000-0.527=-0.527
min418.000-414.000=4.000
max418.000-415.000=3.000
mean0.066-0.068=-0.003
σ0.004-0.004=0.001
min0.061-0.066=-0.004
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.362-1755.819=0.543
σ0.367-0.363=0.005
min1755.790-1755.251=0.539
max1756.951-1756.413=0.538
mean1648.600-1651.650=-3.050
σ640.100-630.599=9.501
min673.000-629.000=44.000
max2733.000-2761.000=-28.000
mean2.342-2.717=-0.376
σ0.105-0.269=-0.163
min2.181-2.212=-0.031
max2.563-3.114=-0.551

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.584-321.050=3.535
σ0.043-0.037=0.006
min324.507-320.985=3.523
max324.607-321.073=3.534
mean2733.000-2761.000=-28.000
σ0.000
min2733.000-2761.000=-28.000
max2733.000-2761.000=-28.000
mean0.423-0.421=0.002
σ0.001-0.001=0.000
min0.422-0.419=0.003
max0.425-0.422=0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.137-1981.621=3.517
σ0.016-0.013=0.004
min1985.117-1981.601=3.516
max1985.156-1981.635=3.522
mean2733.000-2761.000=-28.000
σ0.000
min2733.000-2761.000=-28.000
max2733.000-2761.000=-28.000
mean2.686-2.699=-0.013
σ0.149-0.112=0.037
min2.564-2.562=0.002
max2.932-2.847=0.085
iters=5
new-facts=6402
prior-facts=1
mean4808.541-4805.256=3.285
σ7.784-7.706=0.078
min4804.670-4801.761=2.909
max4822.455-4819.040=3.415
mean2733.000-2761.000=-28.000
σ0.000
min2733.000-2761.000=-28.000
max2733.000-2761.000=-28.000
mean8.494-8.888=-0.394
σ0.676-0.243=0.433
min7.762-8.508=-0.746
max9.211-9.151=0.060
iters=5
new-facts=6402
prior-facts=6402
mean4996.339-4992.833=3.506
σ0.019-0.015=0.005
min4996.313-4992.816=3.498
max4996.355-4992.845=3.510
mean3026.400-3053.400=-27.000
σ347.765-298.366=49.399
min2733.000-2761.000=-28.000
max3542.000-3358.000=184.000
mean8.500-8.848=-0.348
σ0.139-0.322=-0.183
min8.403-8.455=-0.052
max8.744-9.310=-0.566

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.025=-0.023
σ0.067-0.114=-0.047
min0.920-0.916=0.003
max1.055-1.193=-0.138

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.971-462.417=0.555
σ574.281-574.229=0.052
min175.820-175.291=0.529
max1324.393-1323.761=0.632
mean86.250
σ8.500
min82.000
max99.000
mean2733.000-2761.000=-28.000
σ0.000
min2733.000-2761.000=-28.000
max2733.000-2761.000=-28.000
mean0.496-0.423=0.073
σ0.445-0.285=0.160
min0.273-0.277=-0.004
max1.163-0.850=0.312
policies=20
mean1758.530-1753.215=5.315
σ0.328-0.348=-0.021
min1758.297-1752.988=5.309
max1759.015-1753.734=5.281
mean820.000
σ0.000
min820.000
max820.000
mean2733.000-2761.000=-28.000
σ0.000
min2733.000-2761.000=-28.000
max2733.000-2761.000=-28.000
mean2.714-2.813=-0.099
σ0.011-0.076=-0.065
min2.703-2.768=-0.065
max2.726-2.927=-0.201
policies=200
mean17592.313-17537.514=54.799
σ0.596-0.632=-0.036
min17591.912-17537.056=54.856
max17593.197-17538.449=54.748
mean8200.000
σ0.000
min8200.000
max8200.000
mean2733.000-2761.000=-28.000
σ0.000
min2733.000-2761.000=-28.000
max2733.000-2761.000=-28.000
mean27.324-27.354=-0.030
σ0.234-0.163=0.071
min27.087-27.193=-0.106
max27.573-27.531=0.041