Compare commits

Home / Compare 09f37ac8 .. 5458ca12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.914=-0.266
σ0.367-0.366=0.001
min53.518-53.777=-0.259
max54.692-54.956=-0.264
mean413.000
σ0.000
min413.000
max413.000
mean0.140-0.140=0.000
σ0.004-0.004=0.001
min0.135-0.136=-0.001
max0.147-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean42.941-43.145=-0.204
σ0.004-0.012=-0.008
min42.934-43.135=-0.201
max42.948-43.174=-0.226
mean413.000
σ0.000
min413.000
max413.000
mean0.121-0.122=-0.001
σ0.003-0.004=-0.001
min0.118-0.116=0.001
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.803-991.807=-0.005
σ1.253-1.267=-0.015
min991.248-991.247=0.001
max997.074-997.146=-0.072
mean1063.000-1068.400=-5.400
σ322.010-327.756=-5.745
min566.000-565.000=1.000
max1636.000-1641.000=-5.000
mean1.532-1.540=-0.008
σ0.121-0.155=-0.034
min1.373-1.312=0.062
max1.874-1.982=-0.108

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.412=-0.019
σ0.010-0.011=-0.001
min285.375-285.393=-0.018
max285.400-285.421=-0.021
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.378-0.375=0.003
σ0.007-0.006=0.001
min0.373-0.369=0.005
max0.391-0.382=0.009
iters=5
new-facts=1
prior-facts=6402
mean1285.358-1285.372=-0.014
σ0.136-0.134=0.002
min1285.293-1285.306=-0.012
max1285.601-1285.611=-0.011
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean1.871-1.934=-0.063
σ0.074-0.120=-0.046
min1.815-1.821=-0.007
max1.989-2.130=-0.140
iters=5
new-facts=6402
prior-facts=1
mean1807.716-1807.723=-0.007
σ6.987-7.004=-0.018
min1804.361-1804.384=-0.023
max1820.198-1820.238=-0.040
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean4.243-4.220=0.024
σ0.184-0.132=0.052
min4.092-4.102=-0.010
max4.523-4.445=0.077
iters=5
new-facts=6402
prior-facts=6402
mean2070.173-2070.196=-0.024
σ0.010-0.006=0.003
min2070.163-2070.187=-0.024
max2070.188-2070.205=-0.017
mean1847.800-1852.000=-4.200
σ175.317-187.283=-11.966
min1636.000-1641.000=-5.000
max2091.000-2088.000=3.000
mean4.461-4.555=-0.095
σ0.045-0.076=-0.030
min4.419-4.457=-0.038
max4.535-4.647=-0.111

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.219-1.211=0.008
σ0.320-0.298=0.022
min0.913-0.911=0.002
max1.747-1.666=0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.782-436.788=-0.006
σ572.360-572.361=-0.001
min150.589-150.597=-0.008
max1295.322-1295.329=-0.007
mean90.250
σ8.500
min86.000
max103.000
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean0.522-0.529=-0.007
σ0.545-0.560=-0.015
min0.249-0.246=0.002
max1.339-1.368=-0.029
policies=20
mean1506.184-1506.262=-0.078
σ0.237-0.238=-0.000
min1506.032-1506.109=-0.076
max1506.538-1506.616=-0.078
mean860.000
σ0.000
min860.000
max860.000
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean2.516-2.515=0.002
σ0.032-0.013=0.019
min2.471-2.497=-0.026
max2.539-2.526=0.012
policies=200
mean15069.549-15070.397=-0.849
σ0.046-0.064=-0.018
min15069.499-15070.316=-0.817
max15069.611-15070.462=-0.851
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000-1641.000=-5.000
σ0.000
min1636.000-1641.000=-5.000
max1636.000-1641.000=-5.000
mean25.436-25.437=-0.001
σ0.126-0.094=0.032
min25.303-25.322=-0.018
max25.581-25.513=0.068