Compare commits

Home / Compare 7a98f0b4 .. e1597514

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.000
σ0.368-0.366=0.002
min53.787-53.787=-0.001
max54.961-54.955=0.006
mean416.600-416.000=0.600
σ0.516-0.000=0.516
min416.000
max417.000-416.000=1.000
mean0.138-0.139=-0.001
σ0.003-0.004=-0.000
min0.134-0.135=-0.001
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.001
σ0.006-0.007=-0.001
min43.131-43.129=0.002
max43.151-43.151=-0.000
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.119-0.121=-0.002
σ0.004-0.003=0.001
min0.114-0.117=-0.003
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.792-992.081=-0.289
σ1.265-1.232=0.033
min991.248-991.493=-0.245
max997.117-997.252=-0.135
mean1065.150-1062.700=2.450
σ321.640-312.070=9.570
min569.000-605.000=-36.000
max1629.000-1598.000=31.000
mean1.570-1.539=0.031
σ0.146-0.096=0.050
min1.428-1.409=0.019
max1.995-1.816=0.179

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.665=-0.256
σ0.015-0.021=-0.006
min285.383-285.632=-0.249
max285.422-285.685=-0.263
mean1629.000-1598.000=31.000
σ0.000
min1629.000-1598.000=31.000
max1629.000-1598.000=31.000
mean0.380-0.375=0.005
σ0.009-0.001=0.008
min0.373-0.374=-0.001
max0.393-0.376=0.017
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1285.633=-0.257
σ0.136-0.123=0.012
min1285.307-1285.575=-0.268
max1285.619-1285.853=-0.235
mean1629.000-1598.000=31.000
σ0.000
min1629.000-1598.000=31.000
max1629.000-1598.000=31.000
mean1.938-1.882=0.056
σ0.119-0.059=0.060
min1.832-1.808=0.024
max2.123-1.956=0.167
iters=5
new-facts=6402
prior-facts=1
mean1807.728-1807.994=-0.266
σ6.961-6.998=-0.038
min1804.381-1804.649=-0.268
max1820.163-1820.499=-0.336
mean1629.000-1598.000=31.000
σ0.000
min1629.000-1598.000=31.000
max1629.000-1598.000=31.000
mean4.198-4.269=-0.071
σ0.156-0.171=-0.015
min4.073-4.078=-0.004
max4.466-4.481=-0.015
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.467=-0.271
σ0.008-0.011=-0.003
min2070.184-2070.459=-0.275
max2070.205-2070.485=-0.280
mean1835.400-1851.800=-16.400
σ181.182-209.992=-28.810
min1629.000-1598.000=31.000
max2073.000-2087.000=-14.000
mean4.491-4.541=-0.049
σ0.025-0.107=-0.082
min4.475-4.416=0.060
max4.536-4.687=-0.151

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.165-1.318=-0.153
σ0.248-0.303=-0.056
min0.902-0.985=-0.084
max1.502-1.677=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-437.378=-0.594
σ572.366-572.364=0.002
min150.596-151.194=-0.599
max1295.333-1295.924=-0.591
mean90.250
σ8.500
min86.000
max103.000
mean1629.000-1598.000=31.000
σ0.000
min1629.000-1598.000=31.000
max1629.000-1598.000=31.000
mean0.519-0.520=-0.001
σ0.537-0.533=0.004
min0.248-0.250=-0.002
max1.325-1.320=0.005
policies=20
mean1506.256-1512.173=-5.917
σ0.221-0.200=0.021
min1506.109-1512.026=-5.917
max1506.585-1512.468=-5.883
mean860.000
σ0.000
min860.000
max860.000
mean1629.000-1598.000=31.000
σ0.000
min1629.000-1598.000=31.000
max1629.000-1598.000=31.000
mean2.497-2.519=-0.022
σ0.007-0.023=-0.016
min2.489-2.494=-0.005
max2.507-2.539=-0.032
policies=200
mean15070.287-15129.511=-59.224
σ0.082-0.414=-0.332
min15070.177-15128.898=-58.721
max15070.364-15129.788=-59.424
mean8600.000
σ0.000
min8600.000
max8600.000
mean1629.000-1598.000=31.000
σ0.000
min1629.000-1598.000=31.000
max1629.000-1598.000=31.000
mean25.383-25.592=-0.210
σ0.066-0.116=-0.051
min25.328-25.474=-0.146
max25.469-25.740=-0.272