Compare commits

Home / Compare d56839e7 .. 3470cda8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.001
σ0.107-0.107=-0.000
min35.922-35.925=-0.004
max36.276-36.277=-0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.078-0.076=0.002
σ0.004-0.004=-0.001
min0.075-0.071=0.004
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.207=0.001
σ0.002-0.003=-0.001
min26.204-26.201=0.002
max26.211-26.212=-0.000
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.061-0.061=0.001
σ0.003-0.004=-0.001
min0.059-0.056=0.003
max0.069-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.362-1758.376=-0.014
σ0.372-0.370=0.002
min1757.786-1757.798=-0.012
max1758.961-1758.951=0.010
mean1655.150-1638.550=16.600
σ620.424-618.149=2.276
min685.000-671.000=14.000
max2746.000-2753.000=-7.000
mean2.368-2.413=-0.045
σ0.114-0.157=-0.043
min2.178-2.280=-0.102
max2.634-2.989=-0.355

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.512-279.542=-0.030
σ0.007-0.007=0.000
min279.503-279.534=-0.031
max279.517-279.553=-0.035
mean2746.000-2753.000=-7.000
σ0.000
min2746.000-2753.000=-7.000
max2746.000-2753.000=-7.000
mean0.409-0.407=0.002
σ0.002-0.005=-0.003
min0.405-0.404=0.002
max0.410-0.415=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2178.418-2178.458=-0.040
σ0.034-0.022=0.011
min2178.359-2178.426=-0.066
max2178.443-2178.485=-0.042
mean2746.000-2753.000=-7.000
σ0.000
min2746.000-2753.000=-7.000
max2746.000-2753.000=-7.000
mean3.432-3.323=0.109
σ0.172-0.097=0.074
min3.271-3.232=0.038
max3.620-3.459=0.161
iters=5
new-facts=6402
prior-facts=1
mean5056.392-5056.412=-0.020
σ1.004-0.995=0.008
min5055.790-5055.793=-0.003
max5058.177-5058.181=-0.004
mean2746.000-2753.000=-7.000
σ0.000
min2746.000-2753.000=-7.000
max2746.000-2753.000=-7.000
mean8.715-8.902=-0.187
σ0.657-0.671=-0.014
min8.163-8.141=0.022
max9.736-9.739=-0.003
iters=5
new-facts=6402
prior-facts=6402
mean5193.689-5193.769=-0.080
σ0.212-0.097=0.116
min5193.338-5193.681=-0.342
max5193.874-5193.891=-0.017
mean3285.800-3290.000=-4.200
σ404.146-456.657=-52.511
min2746.000-2753.000=-7.000
max3673.000-3922.000=-249.000
mean8.832-8.933=-0.101
σ0.095-0.107=-0.012
min8.705-8.846=-0.141
max8.970-9.116=-0.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-1.008=-0.007
σ0.072-0.070=0.002
min0.937-0.947=-0.010
max1.080-1.093=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.476-465.548=-0.072
σ572.661-572.684=-0.023
min179.137-179.195=-0.058
max1324.468-1324.574=-0.106
mean79.500
σ7.000
min76.000
max90.000
mean2746.000-2753.000=-7.000
σ0.000
min2746.000-2753.000=-7.000
max2746.000-2753.000=-7.000
mean0.474-0.565=-0.091
σ0.379-0.560=-0.182
min0.282-0.282=0.000
max1.042-1.405=-0.364
policies=20
mean1791.671-1792.278=-0.607
σ0.340-0.351=-0.011
min1791.474-1792.057=-0.583
max1792.178-1792.801=-0.623
mean760.000
σ0.000
min760.000
max760.000
mean2746.000-2753.000=-7.000
σ0.000
min2746.000-2753.000=-7.000
max2746.000-2753.000=-7.000
mean2.818-2.793=0.025
σ0.006-0.008=-0.002
min2.811-2.785=0.026
max2.824-2.801=0.023
policies=200
mean17923.168-17929.565=-6.397
σ0.510-0.499=0.011
min17922.880-17929.289=-6.409
max17923.933-17930.313=-6.380
mean7600.000
σ0.000
min7600.000
max7600.000
mean2746.000-2753.000=-7.000
σ0.000
min2746.000-2753.000=-7.000
max2746.000-2753.000=-7.000
mean28.237-28.202=0.036
σ0.094-0.080=0.014
min28.152-28.114=0.039
max28.368-28.278=0.090