Compare commits

Home / Compare 9ccd0263 .. c21f2a1c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.392=0.000
σ0.046-0.042=0.004
min70.364-70.367=-0.003
max70.520-70.510=0.011
mean417.400-415.000=2.400
σ0.516-0.000=0.516
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.154-0.160=-0.006
σ0.005-0.002=0.003
min0.146-0.158=-0.012
max0.161-0.165=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.148-21.148=0.000
σ0.012-0.012=0.000
min21.140-21.141=-0.001
max21.181-21.180=0.000
mean418.000-415.800=2.200
σ0.000-0.422=-0.422
min418.000-415.000=3.000
max418.000-416.000=2.000
mean0.062-0.064=-0.002
σ0.004-0.002=0.002
min0.057-0.062=-0.005
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.697=0.001
σ0.361-0.360=0.000
min1752.126-1752.125=0.001
max1753.279-1753.287=-0.008
mean1657.750-1634.000=23.750
σ626.511-592.563=33.948
min621.000-626.000=-5.000
max2768.000-2424.000=344.000
mean2.721-2.763=-0.042
σ0.237-0.184=0.053
min2.166-2.152=0.014
max3.013-2.972=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.607-270.610=-0.004
σ0.004-0.007=-0.003
min270.602-270.600=0.002
max270.610-270.618=-0.008
mean2768.000-2424.000=344.000
σ0.000
min2768.000-2424.000=344.000
max2768.000-2424.000=344.000
mean0.379-0.378=0.001
σ0.008-0.006=0.003
min0.372-0.370=0.002
max0.393-0.386=0.007
iters=5
new-facts=1
prior-facts=6402
mean1931.047-1931.038=0.009
σ0.008-0.006=0.002
min1931.037-1931.031=0.006
max1931.057-1931.046=0.011
mean2768.000-2424.000=344.000
σ0.000
min2768.000-2424.000=344.000
max2768.000-2424.000=344.000
mean2.915-2.983=-0.068
σ0.144-0.145=-0.001
min2.708-2.747=-0.039
max3.081-3.127=-0.046
iters=5
new-facts=6402
prior-facts=1
mean4751.721-4751.599=0.123
σ0.894-1.010=-0.116
min4751.261-4750.780=0.480
max4753.319-4753.364=-0.044
mean2768.000-2424.000=344.000
σ0.000
min2768.000-2424.000=344.000
max2768.000-2424.000=344.000
mean8.729-8.852=-0.123
σ0.292-0.152=0.140
min8.300-8.610=-0.310
max9.068-9.015=0.053
iters=5
new-facts=6402
prior-facts=6402
mean4942.227-4942.232=-0.005
σ0.013-0.019=-0.006
min4942.212-4942.209=0.003
max4942.237-4942.249=-0.011
mean2955.000-3022.800=-67.800
σ256.102-311.225=-55.123
min2768.000-2604.000=164.000
max3362.000-3417.000=-55.000
mean8.430-8.629=-0.199
σ0.040-0.162=-0.122
min8.378-8.447=-0.070
max8.487-8.845=-0.358

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.728=-0.602
σ0.264-0.232=0.032
min0.934-1.373=-0.439
max1.477-1.984=-0.507

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.212-467.201=0.011
σ575.943-575.927=0.016
min179.228-179.229=-0.001
max1331.127-1331.092=0.035
mean86.250
σ8.500
min82.000
max99.000
mean2768.000-2424.000=344.000
σ0.000
min2768.000-2424.000=344.000
max2768.000-2424.000=344.000
mean0.490-0.560=-0.070
σ0.413-0.556=-0.143
min0.282-0.280=0.002
max1.109-1.393=-0.285
policies=20
mean1792.627-1792.607=0.020
σ0.365-0.384=-0.018
min1792.374-1792.355=0.019
max1793.170-1793.178=-0.009
mean820.000
σ0.000
min820.000
max820.000
mean2768.000-2424.000=344.000
σ0.000
min2768.000-2424.000=344.000
max2768.000-2424.000=344.000
mean2.786-2.785=0.000
σ0.008-0.015=-0.007
min2.778-2.763=0.014
max2.796-2.796=0.000
policies=200
mean17932.982-17933.081=-0.099
σ0.431-0.475=-0.044
min17932.683-17932.779=-0.095
max17933.620-17933.789=-0.169
mean8200.000
σ0.000
min8200.000
max8200.000
mean2768.000-2424.000=344.000
σ0.000
min2768.000-2424.000=344.000
max2768.000-2424.000=344.000
mean28.067-28.054=0.013
σ0.167-0.067=0.100
min27.887-27.986=-0.099
max28.285-28.130=0.155