Compare commits

Home / Compare 93d2dc45 .. c3cac666

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.041=-0.002
σ0.048-0.049=-0.001
min30.999-31.001=-0.001
max31.171-31.176=-0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.078-0.079=-0.000
σ0.003-0.003=0.000
min0.075-0.076=-0.001
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.002=0.000
min21.140-21.140=-0.000
max21.147-21.146=0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.064-0.064=-0.001
σ0.003-0.004=-0.000
min0.058-0.059=-0.000
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.410=-0.001
σ0.362-0.362=-0.000
min1750.840-1750.840=-0.001
max1751.993-1752.001=-0.008
mean1655.450-1662.700=-7.250
σ645.133-637.344=7.790
min632.000-624.000=8.000
max2849.000-2814.000=35.000
mean2.815-2.744=0.072
σ0.116-0.212=-0.096
min2.528-2.160=0.369
max2.993-3.056=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.786-266.784=0.002
σ0.007-0.007=0.001
min266.776-266.777=-0.001
max266.795-266.794=0.001
mean2849.000-2814.000=35.000
σ0.000
min2849.000-2814.000=35.000
max2849.000-2814.000=35.000
mean0.364-0.368=-0.003
σ0.001-0.004=-0.003
min0.362-0.365=-0.003
max0.366-0.375=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1927.207-1927.217=-0.010
σ0.011-0.011=0.000
min1927.190-1927.208=-0.018
max1927.216-1927.235=-0.018
mean2849.000-2814.000=35.000
σ0.000
min2849.000-2814.000=35.000
max2849.000-2814.000=35.000
mean3.031-2.976=0.055
σ0.097-0.067=0.030
min2.950-2.875=0.075
max3.168-3.061=0.107
iters=5
new-facts=6402
prior-facts=1
mean4747.728-4747.749=-0.021
σ0.782-0.798=-0.016
min4747.328-4747.279=0.049
max4749.126-4749.168=-0.043
mean2849.000-2814.000=35.000
σ0.000
min2849.000-2814.000=35.000
max2849.000-2814.000=35.000
mean8.244-8.262=-0.018
σ0.646-0.754=-0.108
min7.666-7.649=0.017
max9.067-9.396=-0.330
iters=5
new-facts=6402
prior-facts=6402
mean4938.092-4938.162=-0.070
σ0.208-0.081=0.126
min4937.754-4938.098=-0.344
max4938.265-4938.252=0.013
mean3053.200-3064.000=-10.800
σ257.959-316.465=-58.506
min2849.000-2814.000=35.000
max3436.000-3544.000=-108.000
mean8.573-8.563=0.010
σ0.241-0.355=-0.114
min8.379-8.359=0.020
max8.982-9.191=-0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.158-1.081=0.077
σ0.260-0.122=0.138
min0.929-0.929=-0.001
max1.493-1.271=0.222

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.123-465.119=0.004
σ575.766-575.753=0.013
min177.234-177.238=-0.004
max1328.773-1328.749=0.023
mean79.750
σ7.500
min76.000
max91.000
mean2849.000-2814.000=35.000
σ0.000
min2849.000-2814.000=35.000
max2849.000-2814.000=35.000
mean0.438-0.437=0.002
σ0.304-0.307=-0.003
min0.281-0.280=0.001
max0.895-0.897=-0.002
policies=20
mean1772.619-1772.611=0.008
σ0.339-0.322=0.017
min1772.367-1772.370=-0.003
max1773.113-1773.073=0.040
mean760.000
σ0.000
min760.000
max760.000
mean2849.000-2814.000=35.000
σ0.000
min2849.000-2814.000=35.000
max2849.000-2814.000=35.000
mean2.833-2.847=-0.014
σ0.008-0.111=-0.103
min2.826-2.743=0.084
max2.844-3.005=-0.160
policies=200
mean17732.564-17732.473=0.091
σ0.444-0.532=-0.089
min17732.294-17732.038=0.255
max17733.221-17733.250=-0.028
mean7600.000
σ0.000
min7600.000
max7600.000
mean2849.000-2814.000=35.000
σ0.000
min2849.000-2814.000=35.000
max2849.000-2814.000=35.000
mean28.184-27.715=0.469
σ0.426-0.132=0.294
min27.713-27.602=0.111
max28.621-27.887=0.734