Compare commits

Home / Compare a49f4fd0 .. ffe6045d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.310-54.430=-1.121
σ0.367-0.050=0.317
min53.171-54.394=-1.224
max54.353-54.568=-0.215
mean417.300-414.000=3.300
σ0.483-0.000=0.483
min417.000-414.000=3.000
max418.000-414.000=4.000
mean0.136-0.137=-0.001
σ0.005-0.003=0.002
min0.129-0.134=-0.005
max0.144-0.140=0.004
cache=y
dps=1
iters=10
policies=100
mean42.545-43.760=-1.214
σ0.013-0.003=0.010
min42.528-43.756=-1.228
max42.574-43.766=-1.191
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.118-0.118=0.001
σ0.003-0.004=-0.001
min0.115-0.114=0.001
max0.124-0.126=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean989.875-1764.851=-774.976
σ1.245-0.365=0.881
min989.292-1764.274=-774.982
max995.108-1765.432=-770.324
mean1055.200-1657.950=-602.750
σ294.917-638.232=-343.315
min622.000
max1473.000-2766.000=-1293.000
mean1.531-2.629=-1.098
σ0.081-0.288=-0.207
min1.389-2.291=-0.903
max1.747-3.261=-1.514

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.215-337.088=-56.873
σ0.010-18.105=-18.095
min280.203-304.702=-24.499
max280.225-345.233=-65.008
mean1473.000-2766.000=-1293.000
σ0.000
min1473.000-2766.000=-1293.000
max1473.000-2766.000=-1293.000
mean0.370-0.436=-0.066
σ0.004-0.028=-0.024
min0.368-0.386=-0.018
max0.377-0.455=-0.078
iters=5
new-facts=1
prior-facts=6402
mean1280.283-2007.367=-727.084
σ0.124-0.011=0.113
min1280.214-2007.350=-727.136
max1280.502-2007.378=-726.876
mean1473.000-2766.000=-1293.000
σ0.000
min1473.000-2766.000=-1293.000
max1473.000-2766.000=-1293.000
mean1.841-2.778=-0.937
σ0.040-0.133=-0.093
min1.799-2.683=-0.884
max1.902-3.010=-1.107
iters=5
new-facts=6402
prior-facts=1
mean1802.580-4832.148=-3029.568
σ7.057-7.809=-0.751
min1799.178-4828.173=-3028.995
max1815.188-4846.107=-3030.919
mean1473.000-2766.000=-1293.000
σ0.000
min1473.000-2766.000=-1293.000
max1473.000-2766.000=-1293.000
mean4.305-8.687=-4.382
σ0.203-0.687=-0.484
min4.006-7.762=-3.756
max4.481-9.334=-4.853
iters=5
new-facts=6402
prior-facts=6402
mean2065.010-5019.703=-2954.693
σ0.011-0.162=-0.151
min2065.002-5019.416=-2954.414
max2065.028-5019.791=-2954.763
mean1802.000-2992.200=-1190.200
σ195.974-222.365=-26.391
min1561.000-2766.000=-1205.000
max1993.000-3314.000=-1321.000
mean4.412-9.805=-5.394
σ0.087-0.165=-0.078
min4.329-9.578=-5.249
max4.532-10.038=-5.506

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.793-1.026=0.767
σ0.064-0.126=-0.062
min1.702-0.912=0.790
max1.868-1.222=0.646

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean435.103-466.710=-31.607
σ572.812-574.760=-1.947
min148.692-179.317=-30.625
max1294.321-1328.849=-34.528
mean90.250
σ8.500
min86.000
max103.000
mean1473.000-2766.000=-1293.000
σ0.000
min1473.000-2766.000=-1293.000
max1473.000-2766.000=-1293.000
mean0.524-0.438=0.086
σ0.539-0.308=0.231
min0.252-0.282=-0.030
max1.333-0.900=0.433
policies=20
mean1487.169-1793.485=-306.316
σ0.236-0.374=-0.138
min1487.007-1793.212=-306.205
max1487.519-1794.033=-306.515
mean860.000
σ0.000
min860.000
max860.000
mean1473.000-2766.000=-1293.000
σ0.000
min1473.000-2766.000=-1293.000
max1473.000-2766.000=-1293.000
mean2.503-2.834=-0.331
σ0.022-0.006=0.016
min2.471-2.828=-0.358
max2.518-2.841=-0.323
policies=200
mean14879.297-17942.093=-3062.797
σ0.101-0.509=-0.408
min14879.222-17941.777=-3062.554
max14879.442-17942.852=-3063.409
mean8600.000
σ0.000
min8600.000
max8600.000
mean1473.000-2766.000=-1293.000
σ0.000
min1473.000-2766.000=-1293.000
max1473.000-2766.000=-1293.000
mean25.315-27.863=-2.548
σ0.160-0.252=-0.091
min25.178-27.585=-2.407
max25.505-28.137=-2.631