Compare commits

Home / Compare 8b20c1bb .. 341f1a62

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.042-31.040=0.002
σ0.048-0.050=-0.002
min31.000-31.001=-0.000
max31.174-31.179=-0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.077-0.079=-0.002
σ0.004-0.003=0.001
min0.070-0.076=-0.007
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.003-0.002=0.001
min21.138-21.140=-0.002
max21.147-21.146=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.065=-0.000
σ0.003-0.003=-0.000
min0.060-0.062=-0.003
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=0.000
σ0.361-0.361=0.000
min1750.846-1750.850=-0.004
max1751.986-1751.979=0.008
mean1640.350-1656.050=-15.700
σ619.230-646.910=-27.680
min650.000-651.000=-1.000
max2478.000-2850.000=-372.000
mean2.810-2.823=-0.013
σ0.140-0.193=-0.053
min2.466-2.355=0.111
max3.048-3.228=-0.180

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.075-279.070=0.005
σ0.011-0.006=0.005
min279.062-279.061=0.000
max279.086-279.076=0.010
mean2478.000-2850.000=-372.000
σ0.000
min2478.000-2850.000=-372.000
max2478.000-2850.000=-372.000
mean0.396-0.392=0.005
σ0.009-0.005=0.004
min0.388-0.385=0.003
max0.409-0.397=0.012
iters=5
new-facts=1
prior-facts=6402
mean1939.502-1939.514=-0.013
σ0.002-0.011=-0.009
min1939.499-1939.504=-0.006
max1939.503-1939.531=-0.028
mean2478.000-2850.000=-372.000
σ0.000
min2478.000-2850.000=-372.000
max2478.000-2850.000=-372.000
mean3.018-3.014=0.004
σ0.102-0.070=0.032
min2.908-2.944=-0.037
max3.173-3.133=0.040
iters=5
new-facts=6402
prior-facts=1
mean4759.840-4760.049=-0.208
σ0.749-0.853=-0.104
min4758.990-4759.581=-0.591
max4761.046-4761.567=-0.521
mean2478.000-2850.000=-372.000
σ0.000
min2478.000-2850.000=-372.000
max2478.000-2850.000=-372.000
mean8.144-8.203=-0.060
σ0.594-0.537=0.056
min7.792-7.592=0.200
max9.181-9.026=0.155
iters=5
new-facts=6402
prior-facts=6402
mean4950.392-4950.460=-0.067
σ0.203-0.077=0.126
min4950.058-4950.390=-0.332
max4950.555-4950.550=0.005
mean2937.000-3073.000=-136.000
σ381.737-301.276=80.462
min2478.000-2850.000=-372.000
max3447.000-3540.000=-93.000
mean8.413-8.448=-0.035
σ0.066-0.117=-0.052
min8.311-8.333=-0.023
max8.476-8.646=-0.171

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.836-1.104=0.732
σ0.102-0.081=0.021
min1.704-1.064=0.640
max1.971-1.249=0.722

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.336=-0.002
σ572.199-572.198=0.000
min177.233-177.234=-0.001
max1321.631-1321.633=-0.001
mean79.750
σ7.500
min76.000
max91.000
mean2478.000-2850.000=-372.000
σ0.000
min2478.000-2850.000=-372.000
max2478.000-2850.000=-372.000
mean0.567-0.439=0.129
σ0.571-0.299=0.272
min0.276-0.288=-0.012
max1.424-0.887=0.537
policies=20
mean1772.588-1772.605=-0.017
σ0.333-0.337=-0.005
min1772.367-1772.371=-0.004
max1773.082-1773.101=-0.018
mean760.000
σ0.000
min760.000
max760.000
mean2478.000-2850.000=-372.000
σ0.000
min2478.000-2850.000=-372.000
max2478.000-2850.000=-372.000
mean2.743-2.844=-0.101
σ0.010-0.008=0.003
min2.732-2.833=-0.101
max2.754-2.852=-0.098
policies=200
mean17732.440-17732.481=-0.042
σ0.375-0.459=-0.084
min17732.220-17732.219=0.001
max17732.999-17733.169=-0.170
mean7600.000
σ0.000
min7600.000
max7600.000
mean2478.000-2850.000=-372.000
σ0.000
min2478.000-2850.000=-372.000
max2478.000-2850.000=-372.000
mean27.758-28.196=-0.438
σ0.121-0.489=-0.368
min27.641-27.699=-0.058
max27.928-28.675=-0.748