Compare commits

Home / Compare 8fb7c962 .. be223800

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.970-33.971=-0.001
σ0.053-0.053=0.000
min33.939-33.940=-0.001
max34.120-34.121=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.081-0.085=-0.004
σ0.004-0.003=0.001
min0.076-0.082=-0.006
max0.086-0.091=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.000
σ0.003-0.003=-0.000
min23.312-23.311=0.001
max23.323-23.322=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.059-0.064=-0.005
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean998.459-998.459=-0.000
σ0.188-0.188=-0.001
min998.182-998.186=-0.004
max998.760-998.761=-0.002
mean1065.350-1050.750=14.600
σ313.733-299.478=14.255
min619.000-640.000=-21.000
max1619.000-1513.000=106.000
mean1.425-1.432=-0.007
σ0.065-0.076=-0.011
min1.319-1.370=-0.050
max1.630-1.696=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.791-286.769=0.023
σ0.002-0.005=-0.003
min286.789-286.762=0.027
max286.794-286.775=0.018
mean1619.000-1513.000=106.000
σ0.000
min1619.000-1513.000=106.000
max1619.000-1513.000=106.000
mean0.367-0.370=-0.003
σ0.001-0.006=-0.005
min0.366-0.364=0.002
max0.368-0.379=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1286.879-1286.865=0.013
σ0.017-0.029=-0.013
min1286.857-1286.813=0.044
max1286.899-1286.883=0.016
mean1619.000-1513.000=106.000
σ0.000
min1619.000-1513.000=106.000
max1619.000-1513.000=106.000
mean1.884-1.895=-0.011
σ0.109-0.106=0.003
min1.818-1.803=0.016
max2.076-2.040=0.036
iters=5
new-facts=6402
prior-facts=1
mean4110.247-4110.157=0.090
σ7.415-7.490=-0.075
min4106.917-4106.391=0.526
max4123.511-4123.549=-0.038
mean1619.000-1513.000=106.000
σ0.000
min1619.000-1513.000=106.000
max1619.000-1513.000=106.000
mean7.293-7.401=-0.108
σ0.351-0.323=0.028
min6.842-6.917=-0.076
max7.707-7.763=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean4100.135-4100.153=-0.017
σ0.033-0.048=-0.015
min4100.110-4100.105=0.005
max4100.193-4100.228=-0.035
mean1806.200-1802.200=4.000
σ161.838-172.162=-10.323
min1619.000-1591.000=28.000
max2034.000-2038.000=-4.000
mean7.789-7.761=0.028
σ0.350-0.264=0.086
min7.290-7.425=-0.135
max8.224-8.128=0.096

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.111-1.541=-0.430
σ0.287-0.364=-0.077
min0.913-0.947=-0.033
max1.614-1.848=-0.235

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.445-464.433=0.012
σ574.786-574.777=0.010
min177.040-177.041=-0.001
max1326.625-1326.598=0.027
mean88.250
σ8.500
min84.000
max101.000
mean1619.000-1513.000=106.000
σ0.000
min1619.000-1513.000=106.000
max1619.000-1513.000=106.000
mean0.552-0.534=0.018
σ0.557-0.519=0.038
min0.272-0.273=-0.001
max1.388-1.312=0.075
policies=20
mean1770.739-1770.743=-0.004
σ0.367-0.365=0.002
min1770.525-1770.519=0.006
max1771.289-1771.289=-0.000
mean840.000
σ0.000
min840.000
max840.000
mean1619.000-1513.000=106.000
σ0.000
min1619.000-1513.000=106.000
max1619.000-1513.000=106.000
mean2.715-2.717=-0.002
σ0.019-0.012=0.007
min2.700-2.703=-0.003
max2.742-2.731=0.011
policies=200
mean17714.927-17714.897=0.030
σ0.425-0.370=0.055
min17714.636-17714.668=-0.032
max17715.555-17715.450=0.105
mean8400.000
σ0.000
min8400.000
max8400.000
mean1619.000-1513.000=106.000
σ0.000
min1619.000-1513.000=106.000
max1619.000-1513.000=106.000
mean27.383-27.443=-0.060
σ0.193-0.112=0.081
min27.127-27.350=-0.223
max27.568-27.603=-0.035