Compare commits

Home / Compare a890b024 .. 89edd71a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.917-53.915=0.002
σ0.368-0.367=0.001
min53.785-53.787=-0.003
max54.965-54.960=0.005
mean414.000-416.800=-2.800
σ0.000-0.422=-0.422
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.146-0.139=0.007
σ0.008-0.003=0.005
min0.138-0.136=0.001
max0.158-0.144=0.014
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.000
σ0.007-0.004=0.002
min43.131-43.135=-0.004
max43.151-43.148=0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.121-0.121=0.000
σ0.004-0.004=0.000
min0.113-0.115=-0.002
max0.127-0.126=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.820-991.806=0.014
σ1.239-1.248=-0.009
min991.230-991.252=-0.022
max997.020-997.059=-0.039
mean1067.900-1068.400=-0.500
σ312.912-319.723=-6.811
min614.000-590.000=24.000
max1645.000-1633.000=12.000
mean1.540-1.554=-0.014
σ0.068-0.148=-0.079
min1.422-1.404=0.018
max1.719-1.997=-0.278

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.410=0.000
σ0.014-0.013=0.001
min285.393-285.392=0.001
max285.432-285.429=0.003
mean1645.000-1633.000=12.000
σ0.000
min1645.000-1633.000=12.000
max1645.000-1633.000=12.000
mean0.375-0.372=0.003
σ0.009-0.005=0.004
min0.368-0.369=-0.001
max0.388-0.381=0.008
iters=5
new-facts=1
prior-facts=6402
mean1285.365-1285.377=-0.012
σ0.114-0.137=-0.023
min1285.308-1285.308=-0.000
max1285.569-1285.622=-0.053
mean1645.000-1633.000=12.000
σ0.000
min1645.000-1633.000=12.000
max1645.000-1633.000=12.000
mean1.916-1.921=-0.005
σ0.178-0.066=0.112
min1.753-1.808=-0.055
max2.216-1.981=0.235
iters=5
new-facts=6402
prior-facts=1
mean1807.686-1807.711=-0.025
σ7.019-7.010=0.009
min1804.333-1804.344=-0.011
max1820.226-1820.235=-0.009
mean1645.000-1633.000=12.000
σ0.000
min1645.000-1633.000=12.000
max1645.000-1633.000=12.000
mean4.096-4.184=-0.089
σ0.205-0.295=-0.091
min3.902-3.854=0.049
max4.397-4.568=-0.171
iters=5
new-facts=6402
prior-facts=6402
mean2070.199-2070.193=0.006
σ0.013-0.010=0.003
min2070.186-2070.179=0.006
max2070.219-2070.207=0.012
mean1839.200-1794.600=44.600
σ169.259-176.554=-7.295
min1645.000-1633.000=12.000
max2076.000-2044.000=32.000
mean4.496-4.465=0.031
σ0.029-0.195=-0.166
min4.462-4.336=0.127
max4.536-4.809=-0.273

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.231=-0.003
σ0.346-0.359=-0.013
min0.908-0.920=-0.012
max1.784-1.839=-0.055

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.784-436.786=-0.002
σ572.360-572.358=0.001
min150.595-150.597=-0.001
max1295.324-1295.324=0.000
mean90.250
σ8.500
min86.000
max103.000
mean1645.000-1633.000=12.000
σ0.000
min1645.000-1633.000=12.000
max1645.000-1633.000=12.000
mean0.522-0.522=-0.001
σ0.545-0.547=-0.001
min0.247-0.248=-0.001
max1.340-1.342=-0.002
policies=20
mean1506.248-1506.243=0.005
σ0.233-0.238=-0.005
min1506.092-1506.091=0.001
max1506.595-1506.598=-0.003
mean860.000
σ0.000
min860.000
max860.000
mean1645.000-1633.000=12.000
σ0.000
min1645.000-1633.000=12.000
max1645.000-1633.000=12.000
mean2.513-2.509=0.004
σ0.009-0.014=-0.006
min2.503-2.492=0.011
max2.524-2.526=-0.003
policies=200
mean15070.316-15070.311=0.005
σ0.121-0.120=0.001
min15070.198-15070.198=0.000
max15070.442-15070.450=-0.008
mean8600.000
σ0.000
min8600.000
max8600.000
mean1645.000-1633.000=12.000
σ0.000
min1645.000-1633.000=12.000
max1645.000-1633.000=12.000
mean25.457-25.526=-0.070
σ0.076-0.091=-0.016
min25.364-25.415=-0.051
max25.526-25.612=-0.086