Compare commits

Home / Compare 9cc197a4 .. 7ad08d79

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.263=0.354
σ0.055-0.055=0.000
min35.587-35.230=0.357
max35.774-35.418=0.356
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.084-0.083=0.000
σ0.006-0.004=0.002
min0.077-0.077=0.000
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean24.047-23.769=0.278
σ0.002-0.003=-0.001
min24.044-23.764=0.280
max24.051-23.774=0.277
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.069-0.067=0.003
σ0.003-0.005=-0.001
min0.067-0.061=0.006
max0.076-0.076=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.485=0.004
σ0.365-0.366=-0.001
min1755.915-1755.909=0.006
max1757.083-1757.079=0.005
mean1661.400-1646.300=15.100
σ643.030-639.692=3.337
min625.000-623.000=2.000
max2782.000-2823.000=-41.000
mean2.367-2.330=0.037
σ0.126-0.067=0.059
min2.251-2.238=0.013
max2.798-2.468=0.330

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.682=0.080
σ0.062-0.051=0.011
min324.654-324.593=0.061
max324.803-324.716=0.086
mean2782.000-2823.000=-41.000
σ0.000
min2782.000-2823.000=-41.000
max2782.000-2823.000=-41.000
mean0.436-0.438=-0.002
σ0.010-0.017=-0.007
min0.430-0.425=0.005
max0.455-0.466=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.326-1985.266=0.059
σ0.011-0.010=0.001
min1985.306-1985.250=0.057
max1985.332-1985.274=0.057
mean2782.000-2823.000=-41.000
σ0.000
min2782.000-2823.000=-41.000
max2782.000-2823.000=-41.000
mean2.637-2.687=-0.050
σ0.083-0.163=-0.080
min2.577-2.510=0.067
max2.764-2.890=-0.126
iters=5
new-facts=6402
prior-facts=1
mean4809.095-4808.672=0.423
σ7.676-7.216=0.460
min4805.642-4805.422=0.220
max4822.826-4821.581=1.245
mean2782.000-2823.000=-41.000
σ0.000
min2782.000-2823.000=-41.000
max2782.000-2823.000=-41.000
mean8.900-9.145=-0.246
σ0.162-0.200=-0.037
min8.626-8.977=-0.351
max9.012-9.469=-0.457
iters=5
new-facts=6402
prior-facts=6402
mean4996.617-4996.467=0.151
σ0.037-0.018=0.019
min4996.557-4996.446=0.110
max4996.658-4996.489=0.169
mean3047.200-3029.400=17.800
σ328.860-281.789=47.071
min2782.000-2823.000=-41.000
max3546.000-3471.000=75.000
mean8.505-8.507=-0.002
σ0.101-0.127=-0.027
min8.427-8.359=0.068
max8.681-8.699=-0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.927-0.973=-0.046
σ0.012-0.067=-0.055
min0.919-0.916=0.003
max0.948-1.052=-0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-462.972=0.236
σ574.767-574.256=0.512
min175.818-175.836=-0.017
max1325.359-1324.355=1.003
mean86.250
σ8.500
min82.000
max99.000
mean2782.000-2823.000=-41.000
σ0.000
min2782.000-2823.000=-41.000
max2782.000-2823.000=-41.000
mean0.430-0.431=-0.001
σ0.296-0.298=-0.002
min0.279-0.278=0.000
max0.875-0.879=-0.004
policies=20
mean1758.526-1758.718=-0.193
σ0.336-0.342=-0.006
min1758.322-1758.487=-0.165
max1759.027-1759.225=-0.198
mean820.000
σ0.000
min820.000
max820.000
mean2782.000-2823.000=-41.000
σ0.000
min2782.000-2823.000=-41.000
max2782.000-2823.000=-41.000
mean2.795-2.799=-0.004
σ0.010-0.004=0.006
min2.781-2.794=-0.013
max2.803-2.801=0.002
policies=200
mean17592.004-17593.366=-1.362
σ0.446-0.723=-0.277
min17591.616-17592.370=-0.754
max17592.648-17593.930=-1.283
mean8200.000
σ0.000
min8200.000
max8200.000
mean2782.000-2823.000=-41.000
σ0.000
min2782.000-2823.000=-41.000
max2782.000-2823.000=-41.000
mean27.544-27.935=-0.391
σ0.099-0.353=-0.253
min27.395-27.588=-0.192
max27.605-28.350=-0.745