Compare commits

Home / Compare 6b69cea8 .. ac83fe43

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.046-0.045=0.001
min70.539-70.541=-0.002
max70.690-70.689=0.001
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.158-0.158=0.001
σ0.004-0.006=-0.001
min0.151-0.150=0.001
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.002-0.004=-0.002
min21.285-21.284=0.001
max21.291-21.295=-0.004
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.061-0.064=-0.003
σ0.004-0.002=0.001
min0.058-0.063=-0.004
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.375=-0.002
σ0.364-0.361=0.003
min1752.795-1752.802=-0.007
max1753.982-1753.978=0.004
mean1658.950-1655.550=3.400
σ637.715-645.375=-7.660
min614.000-633.000=-19.000
max2810.000-2886.000=-76.000
mean2.786-2.812=-0.027
σ0.127-0.166=-0.039
min2.492-2.512=-0.020
max3.022-3.107=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.756=-0.003
σ0.006-0.007=-0.001
min271.742-271.746=-0.004
max271.758-271.762=-0.004
mean2810.000-2886.000=-76.000
σ0.000
min2810.000-2886.000=-76.000
max2810.000-2886.000=-76.000
mean0.383-0.378=0.004
σ0.009-0.005=0.004
min0.369-0.375=-0.006
max0.390-0.388=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.163=0.011
σ0.018-0.007=0.011
min1932.146-1932.157=-0.010
max1932.197-1932.176=0.022
mean2810.000-2886.000=-76.000
σ0.000
min2810.000-2886.000=-76.000
max2810.000-2886.000=-76.000
mean3.027-2.984=0.042
σ0.065-0.106=-0.042
min2.971-2.812=0.160
max3.110-3.102=0.008
iters=5
new-facts=6402
prior-facts=1
mean4752.908-4752.925=-0.017
σ0.911-0.961=-0.051
min4752.429-4752.365=0.064
max4754.528-4754.632=-0.104
mean2810.000-2886.000=-76.000
σ0.000
min2810.000-2886.000=-76.000
max2810.000-2886.000=-76.000
mean8.478-8.632=-0.154
σ0.557-0.682=-0.125
min7.615-7.630=-0.015
max8.928-9.476=-0.547
iters=5
new-facts=6402
prior-facts=6402
mean4943.304-4943.371=-0.066
σ0.156-0.016=0.140
min4943.028-4943.353=-0.325
max4943.398-4943.392=0.006
mean3003.800-3055.200=-51.400
σ259.909-240.995=18.914
min2810.000-2886.000=-76.000
max3409.000-3434.000=-25.000
mean8.418-8.428=-0.010
σ0.074-0.050=0.024
min8.360-8.375=-0.014
max8.543-8.485=0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.082=-0.059
σ0.137-0.208=-0.071
min0.931-0.929=0.002
max1.247-1.351=-0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.858-467.862=-0.004
σ575.936-575.929=0.007
min179.885-179.888=-0.003
max1331.762-1331.755=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2810.000-2886.000=-76.000
σ0.000
min2810.000-2886.000=-76.000
max2810.000-2886.000=-76.000
mean0.481-0.442=0.039
σ0.391-0.303=0.088
min0.284-0.288=-0.004
max1.068-0.897=0.171
policies=20
mean1799.170-1799.167=0.003
σ0.362-0.385=-0.023
min1798.904-1798.898=0.006
max1799.705-1799.736=-0.030
mean820.000
σ0.000
min820.000
max820.000
mean2810.000-2886.000=-76.000
σ0.000
min2810.000-2886.000=-76.000
max2810.000-2886.000=-76.000
mean2.809-2.880=-0.071
σ0.010-0.019=-0.009
min2.797-2.853=-0.056
max2.822-2.899=-0.077
policies=200
mean17998.514-17998.467=0.047
σ0.452-0.528=-0.076
min17998.255-17998.134=0.122
max17999.189-17999.254=-0.064
mean8200.000
σ0.000
min8200.000
max8200.000
mean2810.000-2886.000=-76.000
σ0.000
min2810.000-2886.000=-76.000
max2810.000-2886.000=-76.000
mean28.173-28.485=-0.311
σ0.053-0.490=-0.437
min28.106-27.924=0.182
max28.232-28.921=-0.689