Compare commits

Home / Compare d2a949ca .. c083214d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.914=-0.265
σ0.367-0.368=-0.001
min53.512-53.783=-0.272
max54.694-54.962=-0.268
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.140-0.137=0.003
σ0.003-0.004=-0.000
min0.137-0.131=0.005
max0.145-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean42.942-43.140=-0.198
σ0.006-0.006=-0.000
min42.931-43.131=-0.200
max42.955-43.152=-0.196
mean414.000-416.400=-2.400
σ0.000-0.516=-0.516
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.121-0.120=0.001
σ0.005-0.005=-0.000
min0.113-0.113=-0.000
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.862-992.139=-0.276
σ1.196-1.205=-0.008
min991.332-991.607=-0.274
max996.876-997.190=-0.315
mean1057.800-1057.350=0.450
σ316.451-310.954=5.496
min588.000-603.000=-15.000
max1544.000-1516.000=28.000
mean1.520-1.558=-0.038
σ0.057-0.136=-0.079
min1.454-1.454=0.000
max1.649-2.066=-0.417

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.436-285.724=-0.288
σ0.008-0.011=-0.003
min285.423-285.710=-0.286
max285.444-285.736=-0.292
mean1544.000-1516.000=28.000
σ0.000
min1544.000-1516.000=28.000
max1544.000-1516.000=28.000
mean0.378-0.389=-0.011
σ0.001-0.008=-0.007
min0.376-0.376=0.000
max0.380-0.395=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1285.489-1285.799=-0.310
σ0.074-0.072=0.002
min1285.362-1285.696=-0.334
max1285.548-1285.869=-0.322
mean1544.000-1516.000=28.000
σ0.000
min1544.000-1516.000=28.000
max1544.000-1516.000=28.000
mean1.894-2.004=-0.110
σ0.189-0.279=-0.090
min1.692-1.821=-0.129
max2.193-2.483=-0.291
iters=5
new-facts=6402
prior-facts=1
mean1705.823-1706.118=-0.295
σ6.848-6.933=-0.085
min1702.660-1702.918=-0.258
max1718.070-1718.516=-0.446
mean1544.000-1516.000=28.000
σ0.000
min1544.000-1516.000=28.000
max1544.000-1516.000=28.000
mean2.951-2.949=0.002
σ0.253-0.531=-0.278
min2.693-2.526=0.167
max3.312-3.849=-0.536
iters=5
new-facts=6402
prior-facts=6402
mean1968.449-1968.720=-0.271
σ0.030-0.046=-0.016
min1968.427-1968.656=-0.229
max1968.492-1968.786=-0.293
mean1866.800-1738.000=128.800
σ237.831-168.394=69.437
min1544.000-1516.000=28.000
max2129.000-1947.000=182.000
mean3.294-3.282=0.013
σ0.227-0.345=-0.118
min3.157-3.026=0.131
max3.696-3.872=-0.176

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.578-1.579=-0.000
σ0.191-0.324=-0.133
min1.333-1.223=0.111
max1.784-1.869=-0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.767-437.373=-0.607
σ572.349-572.352=-0.003
min150.586-151.192=-0.606
max1295.290-1295.902=-0.612
mean90.250
σ8.500
min86.000
max103.000
mean1544.000-1516.000=28.000
σ0.000
min1544.000-1516.000=28.000
max1544.000-1516.000=28.000
mean0.518-0.514=0.003
σ0.537-0.516=0.021
min0.247-0.250=-0.003
max1.323-1.289=0.035
policies=20
mean1506.172-1512.206=-6.034
σ0.229-0.256=-0.027
min1506.008-1512.039=-6.031
max1506.510-1512.586=-6.076
mean860.000
σ0.000
min860.000
max860.000
mean1544.000-1516.000=28.000
σ0.000
min1544.000-1516.000=28.000
max1544.000-1516.000=28.000
mean2.499-2.529=-0.030
σ0.010-0.015=-0.005
min2.485-2.513=-0.028
max2.510-2.549=-0.040
policies=200
mean15069.549-15129.580=-60.031
σ0.086-0.110=-0.024
min15069.426-15129.418=-59.992
max15069.614-15129.662=-60.048
mean8600.000
σ0.000
min8600.000
max8600.000
mean1544.000-1516.000=28.000
σ0.000
min1544.000-1516.000=28.000
max1544.000-1516.000=28.000
mean25.411-25.722=-0.311
σ0.136-0.225=-0.089
min25.260-25.434=-0.174
max25.589-25.902=-0.312