Compare commits

Home / Compare 0bb5c034 .. cebd192e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.647=-0.001
σ0.365-0.365=0.000
min53.516-53.515=0.001
max54.686-54.687=-0.000
mean413.800-417.000=-3.200
σ0.422-0.000=0.422
min413.000-417.000=-4.000
max414.000-417.000=-3.000
mean0.137-0.139=-0.002
σ0.004-0.003=0.000
min0.130-0.136=-0.006
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.944-42.943=0.001
σ0.013-0.007=0.006
min42.930-42.933=-0.003
max42.975-42.952=0.023
mean414.000-417.800=-3.800
σ0.000-0.422=-0.422
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.119-0.120=-0.002
σ0.004-0.003=0.001
min0.112-0.118=-0.005
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.809-991.796=0.012
σ1.243-1.228=0.015
min991.226-991.221=0.004
max997.033-996.962=0.072
mean1069.050-1071.950=-2.900
σ313.993-318.279=-4.285
min615.000
max1652.000-1634.000=18.000
mean1.512-1.505=0.007
σ0.069-0.040=0.030
min1.411-1.462=-0.051
max1.704-1.576=0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.391-285.393=-0.001
σ0.012-0.011=0.001
min285.374-285.375=-0.001
max285.404-285.404=-0.000
mean1652.000-1634.000=18.000
σ0.000
min1652.000-1634.000=18.000
max1652.000-1634.000=18.000
mean0.376-0.369=0.007
σ0.006-0.010=-0.005
min0.372-0.354=0.019
max0.386-0.383=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.360-1285.354=0.006
σ0.137-0.135=0.002
min1285.296-1285.289=0.006
max1285.605-1285.594=0.010
mean1652.000-1634.000=18.000
σ0.000
min1652.000-1634.000=18.000
max1652.000-1634.000=18.000
mean1.944-1.872=0.072
σ0.128-0.067=0.061
min1.847-1.822=0.025
max2.144-1.984=0.161
iters=5
new-facts=6402
prior-facts=1
mean1807.702-1807.664=0.038
σ7.020-7.000=0.020
min1804.308-1804.314=-0.006
max1820.241-1820.171=0.071
mean1652.000-1634.000=18.000
σ0.000
min1652.000-1634.000=18.000
max1652.000-1634.000=18.000
mean4.252-4.128=0.124
σ0.276-0.165=0.111
min3.944-3.935=0.009
max4.631-4.377=0.254
iters=5
new-facts=6402
prior-facts=6402
mean2070.179-2070.175=0.004
σ0.011-0.010=0.001
min2070.164-2070.167=-0.003
max2070.195-2070.191=0.004
mean1864.200-1844.800=19.400
σ193.287-192.020=1.267
min1652.000-1634.000=18.000
max2091.000-2089.000=2.000
mean4.531-4.461=0.070
σ0.070-0.044=0.026
min4.456-4.415=0.042
max4.613-4.520=0.093

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.194=0.019
σ0.321-0.329=-0.009
min0.914-0.911=0.003
max1.725-1.753=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.784-436.775=0.008
σ572.361-572.364=-0.004
min150.599-150.588=0.012
max1295.325-1295.322=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1652.000-1634.000=18.000
σ0.000
min1652.000-1634.000=18.000
max1652.000-1634.000=18.000
mean0.516-0.521=-0.004
σ0.535-0.540=-0.005
min0.247-0.249=-0.001
max1.319-1.331=-0.012
policies=20
mean1506.215-1506.164=0.050
σ0.235-0.230=0.005
min1506.056-1506.023=0.033
max1506.564-1506.508=0.056
mean860.000
σ0.000
min860.000
max860.000
mean1652.000-1634.000=18.000
σ0.000
min1652.000-1634.000=18.000
max1652.000-1634.000=18.000
mean2.514-2.515=-0.002
σ0.013-0.012=0.000
min2.504-2.500=0.005
max2.531-2.526=0.005
policies=200
mean15069.871-15069.430=0.441
σ0.051-0.042=0.009
min15069.801-15069.375=0.426
max15069.922-15069.465=0.457
mean8600.000
σ0.000
min8600.000
max8600.000
mean1652.000-1634.000=18.000
σ0.000
min1652.000-1634.000=18.000
max1652.000-1634.000=18.000
mean25.507-25.561=-0.054
σ0.211-0.124=0.087
min25.276-25.414=-0.138
max25.717-25.672=0.045