Compare commits

Home / Compare b5f4e1f6 .. aab98c11

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.769=0.189
σ0.049-0.048=0.001
min30.917-30.730=0.186
max31.093-30.904=0.189
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.079-0.076=0.003
σ0.003-0.004=-0.002
min0.076-0.070=0.005
max0.084-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.059=0.002
σ0.003-0.003=0.000
min21.057-21.056=0.001
max21.066-21.065=0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.064-0.060=0.004
σ0.002-0.004=-0.002
min0.062-0.057=0.005
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1713.515-1751.421=-37.906
σ169.484-0.362=169.122
min993.459-1750.853=-757.394
max1751.976-1752.003=-0.027
mean1628.900-1669.100=-40.200
σ598.368-642.379=-44.012
min639.000-682.000=-43.000
max2504.000-2705.000=-201.000
mean2.758-2.853=-0.096
σ0.344-0.162=0.182
min1.450-2.535=-1.084
max3.183-3.059=0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.402-275.759=-2.357
σ0.010-0.008=0.002
min273.391-275.748=-2.357
max273.413-275.768=-2.356
mean2504.000-2705.000=-201.000
σ0.000
min2504.000-2705.000=-201.000
max2504.000-2705.000=-201.000
mean0.386-0.407=-0.021
σ0.008-0.012=-0.004
min0.376-0.393=-0.016
max0.394-0.417=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1933.847-2168.283=-234.436
σ0.014-0.007=0.007
min1933.829-2168.271=-234.442
max1933.863-2168.287=-234.423
mean2504.000-2705.000=-201.000
σ0.000
min2504.000-2705.000=-201.000
max2504.000-2705.000=-201.000
mean3.003-2.935=0.068
σ0.293-0.115=0.178
min2.532-2.786=-0.254
max3.307-3.067=0.240
iters=5
new-facts=6402
prior-facts=1
mean4754.337-5048.097=-293.760
σ0.875-0.910=-0.036
min4753.762-5047.540=-293.777
max4755.889-5049.715=-293.826
mean2504.000-2705.000=-201.000
σ0.000
min2504.000-2705.000=-201.000
max2504.000-2705.000=-201.000
mean8.559-8.719=-0.160
σ0.573-0.392=0.181
min7.643-8.085=-0.442
max9.054-9.087=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean4944.733-5179.157=-234.424
σ0.120-0.190=-0.070
min4944.546-5178.848=-234.301
max4944.879-5179.314=-234.435
mean3014.200-3204.200=-190.000
σ365.340-345.013=20.327
min2543.000-2716.000=-173.000
max3365.000-3626.000=-261.000
mean8.791-9.765=-0.974
σ0.412-0.261=0.151
min8.497-9.434=-0.937
max9.508-10.152=-0.643

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.545-1.097=0.448
σ0.292-0.118=0.173
min1.152-0.942=0.210
max1.838-1.264=0.574

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.332-463.579=-0.247
σ572.199-572.660=-0.461
min177.227-177.240=-0.013
max1321.631-1322.569=-0.938
mean79.750
σ7.500
min76.000
max91.000
mean2504.000-2705.000=-201.000
σ0.000
min2504.000-2705.000=-201.000
max2504.000-2705.000=-201.000
mean0.550-0.561=-0.011
σ0.541-0.557=-0.016
min0.275-0.278=-0.003
max1.362-1.396=-0.034
policies=20
mean1772.557-1772.636=-0.079
σ0.329-0.327=0.002
min1772.328-1772.404=-0.076
max1773.044-1773.121=-0.077
mean760.000
σ0.000
min760.000
max760.000
mean2504.000-2705.000=-201.000
σ0.000
min2504.000-2705.000=-201.000
max2504.000-2705.000=-201.000
mean2.732-2.753=-0.020
σ0.010-0.015=-0.005
min2.723-2.742=-0.020
max2.746-2.774=-0.029
policies=200
mean17732.327-17732.848=-0.521
σ0.588-0.581=0.007
min17731.986-17732.514=-0.528
max17733.206-17733.718=-0.512
mean7600.000
σ0.000
min7600.000
max7600.000
mean2504.000-2705.000=-201.000
σ0.000
min2504.000-2705.000=-201.000
max2504.000-2705.000=-201.000
mean27.647-27.719=-0.072
σ0.096-0.150=-0.055
min27.534-27.498=0.036
max27.766-27.828=-0.062