Compare commits

Home / Compare 57e742c7 .. da7d1474

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.700=0.001
σ0.046-0.045=0.001
min70.666-70.675=-0.010
max70.828-70.826=0.002
mean414.000-417.800=-3.800
σ0.000-0.422=-0.422
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.158-0.161=-0.003
σ0.005-0.003=0.002
min0.150-0.157=-0.007
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.002-0.003=-0.001
min21.404-21.405=-0.000
max21.411-21.413=-0.002
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.066-0.065=0.000
σ0.004-0.003=0.001
min0.061-0.061=0.000
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.928-1754.930=-0.002
σ0.361-0.360=0.001
min1754.361-1754.366=-0.004
max1755.513-1755.512=0.001
mean1627.800-1639.900=-12.100
σ596.795-617.779=-20.983
min623.000-635.000=-12.000
max2420.000-2480.000=-60.000
mean2.734-2.822=-0.089
σ0.169-0.148=0.021
min2.459-2.568=-0.109
max3.011-3.309=-0.298

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.759=-0.002
σ0.005-0.006=-0.001
min272.752-272.750=0.002
max272.766-272.766=-0.000
mean2420.000-2480.000=-60.000
σ0.000
min2420.000-2480.000=-60.000
max2420.000-2480.000=-60.000
mean0.383-0.386=-0.003
σ0.007-0.011=-0.004
min0.379-0.378=0.001
max0.395-0.401=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.168-1933.162=0.006
σ0.011-0.009=0.001
min1933.151-1933.150=0.000
max1933.177-1933.176=0.001
mean2420.000-2480.000=-60.000
σ0.000
min2420.000-2480.000=-60.000
max2420.000-2480.000=-60.000
mean3.000-3.032=-0.032
σ0.229-0.066=0.163
min2.697-2.940=-0.243
max3.285-3.105=0.181
iters=5
new-facts=6402
prior-facts=1
mean4756.909-4756.897=0.012
σ7.654-7.617=0.037
min4753.419-4753.473=-0.054
max4770.601-4770.522=0.079
mean2420.000-2480.000=-60.000
σ0.000
min2420.000-2480.000=-60.000
max2420.000-2480.000=-60.000
mean8.690-8.639=0.051
σ0.365-0.442=-0.077
min8.091-7.859=0.232
max9.006-8.937=0.069
iters=5
new-facts=6402
prior-facts=6402
mean4944.390-4944.398=-0.008
σ0.024-0.014=0.009
min4944.363-4944.379=-0.015
max4944.411-4944.411=-0.000
mean2896.200-3006.800=-110.600
σ385.879-302.480=83.399
min2420.000-2611.000=-191.000
max3408.000-3390.000=18.000
mean8.380-8.496=-0.116
σ0.057-0.118=-0.061
min8.317-8.380=-0.063
max8.461-8.685=-0.225

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.699-1.721=-0.022
σ0.146-0.073=0.073
min1.458-1.602=-0.144
max1.829-1.788=0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.321-468.316=0.004
σ574.256-574.257=-0.001
min181.188-181.186=0.002
max1329.705-1329.702=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2420.000-2480.000=-60.000
σ0.000
min2420.000-2480.000=-60.000
max2420.000-2480.000=-60.000
mean0.577-0.546=0.032
σ0.586-0.543=0.044
min0.281-0.270=0.012
max1.457-1.360=0.097
policies=20
mean1812.176-1812.187=-0.011
σ0.385-0.412=-0.027
min1811.919-1811.925=-0.006
max1812.746-1812.799=-0.054
mean840.000
σ0.000
min840.000
max840.000
mean2420.000-2480.000=-60.000
σ0.000
min2420.000-2480.000=-60.000
max2420.000-2480.000=-60.000
mean2.820-2.849=-0.029
σ0.010-0.063=-0.053
min2.812-2.809=0.003
max2.835-2.942=-0.108
policies=200
mean18129.062-18129.056=0.006
σ0.488-0.501=-0.013
min18128.781-18128.752=0.029
max18129.793-18129.805=-0.012
mean8400.000
σ0.000
min8400.000
max8400.000
mean2420.000-2480.000=-60.000
σ0.000
min2420.000-2480.000=-60.000
max2420.000-2480.000=-60.000
mean28.421-28.297=0.124
σ0.038-0.086=-0.048
min28.380-28.181=0.199
max28.469-28.384=0.085