Compare commits

Home / Compare 81a599e6 .. 945c56e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.768=0.272
σ0.051-0.048=0.003
min31.000-30.730=0.270
max31.180-30.902=0.279
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.078-0.076=0.002
σ0.003-0.003=-0.001
min0.072-0.070=0.003
max0.084-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean21.142-21.060=0.082
σ0.002-0.002=-0.000
min21.140-21.058=0.082
max21.146-21.064=0.082
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.066-0.063=0.003
σ0.003-0.002=0.001
min0.064-0.062=0.002
max0.073-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.409-1751.419=-0.010
σ0.364-0.362=0.001
min1750.844-1750.852=-0.008
max1751.990-1752.004=-0.014
mean1636.150-1651.850=-15.700
σ618.524-624.959=-6.434
min632.000-683.000=-51.000
max2473.000-2651.000=-178.000
mean2.826-2.824=0.002
σ0.151-0.129=0.023
min2.550-2.450=0.101
max3.159-3.093=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.402-275.755=-2.353
σ0.005-0.009=-0.005
min273.398-275.746=-2.348
max273.407-275.766=-2.358
mean2473.000-2651.000=-178.000
σ0.000
min2473.000-2651.000=-178.000
max2473.000-2651.000=-178.000
mean0.389-0.402=-0.013
σ0.010-0.007=0.003
min0.376-0.396=-0.020
max0.399-0.411=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.842-2168.288=-234.446
σ0.009-0.006=0.004
min1933.831-2168.281=-234.450
max1933.851-2168.295=-234.444
mean2473.000-2651.000=-178.000
σ0.000
min2473.000-2651.000=-178.000
max2473.000-2651.000=-178.000
mean3.075-2.966=0.109
σ0.152-0.140=0.012
min2.915-2.810=0.106
max3.302-3.128=0.174
iters=5
new-facts=6402
prior-facts=1
mean4754.222-5048.108=-293.886
σ0.624-0.916=-0.292
min4753.806-5047.577=-293.772
max4755.326-5049.739=-294.413
mean2473.000-2651.000=-178.000
σ0.000
min2473.000-2651.000=-178.000
max2473.000-2651.000=-178.000
mean8.713-8.863=-0.150
σ0.260-0.504=-0.244
min8.363-8.104=0.259
max9.042-9.384=-0.342
iters=5
new-facts=6402
prior-facts=6402
mean4944.798-5179.247=-234.449
σ0.079-0.061=0.019
min4944.735-5179.191=-234.456
max4944.898-5179.314=-234.416
mean2960.800-3238.000=-277.200
σ340.473-395.686=-55.213
min2523.000-2699.000=-176.000
max3287.000-3744.000=-457.000
mean8.644-10.032=-1.388
σ0.204-0.300=-0.096
min8.460-9.693=-1.233
max8.992-10.395=-1.403

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.762-1.194=0.568
σ0.093-0.385=-0.292
min1.614-0.950=0.664
max1.862-1.837=0.025

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.573=-0.239
σ572.192-572.663=-0.471
min177.234-177.237=-0.002
max1321.622-1322.567=-0.945
mean79.750
σ7.500
min76.000
max91.000
mean2473.000-2651.000=-178.000
σ0.000
min2473.000-2651.000=-178.000
max2473.000-2651.000=-178.000
mean0.554-0.554=-0.000
σ0.550-0.551=-0.001
min0.275-0.276=-0.001
max1.379-1.381=-0.001
policies=20
mean1772.584-1772.647=-0.063
σ0.320-0.337=-0.017
min1772.369-1772.424=-0.055
max1773.058-1773.147=-0.089
mean760.000
σ0.000
min760.000
max760.000
mean2473.000-2651.000=-178.000
σ0.000
min2473.000-2651.000=-178.000
max2473.000-2651.000=-178.000
mean2.739-2.763=-0.023
σ0.013-0.019=-0.006
min2.722-2.749=-0.027
max2.750-2.791=-0.041
policies=200
mean17732.518-17732.985=-0.466
σ0.492-0.345=0.147
min17732.268-17732.780=-0.512
max17733.257-17733.500=-0.243
mean7600.000
σ0.000
min7600.000
max7600.000
mean2473.000-2651.000=-178.000
σ0.000
min2473.000-2651.000=-178.000
max2473.000-2651.000=-178.000
mean27.653-27.760=-0.107
σ0.132-0.099=0.033
min27.523-27.690=-0.166
max27.793-27.900=-0.107