Compare commits

Home / Compare 7f278d34 .. c2f6a5c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean32.849-32.847=0.002
σ0.368-0.371=-0.003
min32.716-32.710=0.006
max33.895-33.902=-0.007
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.084-0.084=-0.001
σ0.003-0.004=-0.001
min0.078-0.082=-0.004
max0.090-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean22.087-22.088=-0.001
σ0.004-0.003=0.001
min22.080-22.081=-0.001
max22.092-22.092=0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.066-0.065=0.001
σ0.004-0.002=0.002
min0.060-0.064=-0.005
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1733.749-1733.175=0.574
σ1.037-1.032=0.004
min1732.976-1732.407=0.570
max1737.905-1737.321=0.585
mean1663.350-1655.650=7.700
σ626.620-628.864=-2.244
min671.000
max2719.000-2714.000=5.000
mean2.352-2.725=-0.373
σ0.148-0.286=-0.138
min2.229-2.253=-0.024
max2.876-3.136=-0.260

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean293.779-292.658=1.122
σ0.011-0.008=0.003
min293.767-292.649=1.118
max293.797-292.670=1.127
mean2719.000-2714.000=5.000
σ0.000
min2719.000-2714.000=5.000
max2719.000-2714.000=5.000
mean0.400-0.400=-0.000
σ0.002-0.005=-0.002
min0.397-0.396=0.001
max0.404-0.408=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1955.771-1953.039=2.731
σ0.037-0.035=0.002
min1955.705-1952.977=2.728
max1955.796-1953.059=2.736
mean2719.000-2714.000=5.000
σ0.000
min2719.000-2714.000=5.000
max2719.000-2714.000=5.000
mean2.747-2.855=-0.108
σ0.132-0.082=0.050
min2.590-2.759=-0.169
max2.892-2.979=-0.086
iters=5
new-facts=6402
prior-facts=1
mean2751.942-2749.245=2.697
σ7.300-7.179=0.121
min2748.432-2745.906=2.525
max2764.996-2762.081=2.915
mean2719.000-2714.000=5.000
σ0.000
min2719.000-2714.000=5.000
max2719.000-2714.000=5.000
mean5.613-5.593=0.020
σ0.579-0.291=0.288
min4.752-5.112=-0.360
max6.327-5.888=0.439
iters=5
new-facts=6402
prior-facts=6402
mean2938.826-2936.107=2.719
σ0.022-0.040=-0.018
min2938.804-2936.069=2.735
max2938.858-2936.176=2.683
mean3007.000-3051.200=-44.200
σ269.447-287.087=-17.641
min2719.000-2714.000=5.000
max3371.000-3317.000=54.000
mean5.977-6.015=-0.038
σ0.461-0.379=0.082
min5.616-5.592=0.024
max6.687-6.553=0.134

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-1.021=-0.046
σ0.138-0.245=-0.107
min0.911-0.910=0.001
max1.222-1.459=-0.237

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.110-436.058=1.052
σ572.817-572.823=-0.006
min150.688-149.634=1.053
max1296.335-1295.292=1.043
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2719.000-2714.000=5.000
σ0.000
min2719.000-2714.000=5.000
max2719.000-2714.000=5.000
mean0.535-0.525=0.010
σ0.564-0.558=0.007
min0.251-0.246=0.005
max1.381-1.362=0.019
policies=20
mean1507.099-1496.576=10.522
σ0.207-0.208=-0.001
min1506.949-1496.416=10.533
max1507.404-1496.878=10.526
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2719.000-2714.000=5.000
σ0.000
min2719.000-2714.000=5.000
max2719.000-2714.000=5.000
mean2.516-2.491=0.025
σ0.009-0.018=-0.009
min2.505-2.473=0.032
max2.526-2.515=0.011
policies=200
mean15078.696-14973.241=105.455
σ0.617-0.580=0.037
min15078.277-14972.895=105.382
max15079.609-14974.109=105.500
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2719.000-2714.000=5.000
σ0.000
min2719.000-2714.000=5.000
max2719.000-2714.000=5.000
mean25.368-25.166=0.202
σ0.077-0.121=-0.044
min25.286-25.075=0.211
max25.465-25.341=0.124