Compare commits

Home / Compare 46efed9e .. dbbeaacd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=0.001
σ0.049-0.049=0.000
min31.002-30.995=0.006
max31.178-31.176=0.002
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.081-0.079=0.001
σ0.003-0.003=-0.000
min0.078-0.076=0.002
max0.087-0.087=0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.002-0.003=-0.000
min21.141-21.138=0.002
max21.148-21.148=0.000
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.065-0.064=0.001
σ0.002-0.002=-0.000
min0.063-0.062=0.001
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.410=0.003
σ0.360-0.362=-0.002
min1750.847-1750.838=0.010
max1751.983-1751.989=-0.006
mean1652.350-1658.400=-6.050
σ645.063-644.778=0.284
min626.000-628.000=-2.000
max2846.000-2774.000=72.000
mean2.835-2.813=0.022
σ0.152-0.215=-0.062
min2.313-2.299=0.014
max3.023-3.158=-0.134

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.782-266.786=-0.004
σ0.008-0.010=-0.001
min266.776-266.777=-0.002
max266.796-266.797=-0.000
mean2846.000-2774.000=72.000
σ0.000
min2846.000-2774.000=72.000
max2846.000-2774.000=72.000
mean0.363-0.368=-0.004
σ0.001-0.008=-0.007
min0.362-0.363=-0.002
max0.364-0.382=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1927.213-1927.222=-0.009
σ0.007-0.020=-0.013
min1927.201-1927.198=0.002
max1927.217-1927.246=-0.029
mean2846.000-2774.000=72.000
σ0.000
min2846.000-2774.000=72.000
max2846.000-2774.000=72.000
mean2.995-2.813=0.182
σ0.088-0.268=-0.180
min2.892-2.451=0.441
max3.132-3.045=0.087
iters=5
new-facts=6402
prior-facts=1
mean4747.747-4747.463=0.285
σ0.779-1.114=-0.335
min4747.383-4746.110=1.273
max4749.140-4749.215=-0.075
mean2846.000-2774.000=72.000
σ0.000
min2846.000-2774.000=72.000
max2846.000-2774.000=72.000
mean8.134-8.696=-0.562
σ0.491-0.286=0.205
min7.679-8.458=-0.779
max8.748-9.170=-0.421
iters=5
new-facts=6402
prior-facts=6402
mean4938.095-4938.168=-0.073
σ0.123-0.088=0.035
min4937.905-4938.095=-0.190
max4938.249-4938.264=-0.015
mean3072.600-3041.200=31.400
σ300.910-210.209=90.701
min2846.000-2774.000=72.000
max3536.000-3323.000=213.000
mean8.411-8.549=-0.138
σ0.200-0.226=-0.026
min8.295-8.313=-0.018
max8.765-8.869=-0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.125=-0.098
σ0.134-0.128=0.006
min0.933-1.060=-0.127
max1.245-1.353=-0.108

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.119-465.124=-0.005
σ575.756-575.764=-0.008
min177.237-177.236=0.001
max1328.753-1328.771=-0.018
mean79.750
σ7.500
min76.000
max91.000
mean2846.000-2774.000=72.000
σ0.000
min2846.000-2774.000=72.000
max2846.000-2774.000=72.000
mean0.443-0.446=-0.003
σ0.308-0.304=0.004
min0.289-0.293=-0.004
max0.906-0.903=0.003
policies=20
mean1772.630-1772.606=0.024
σ0.328-0.320=0.008
min1772.391-1772.372=0.019
max1773.110-1773.074=0.036
mean760.000
σ0.000
min760.000
max760.000
mean2846.000-2774.000=72.000
σ0.000
min2846.000-2774.000=72.000
max2846.000-2774.000=72.000
mean2.838-2.849=-0.011
σ0.008-0.127=-0.119
min2.828-2.750=0.078
max2.847-3.018=-0.171
policies=200
mean17732.483-17732.356=0.127
σ0.330-0.504=-0.173
min17732.210-17732.029=0.181
max17732.963-17733.107=-0.144
mean7600.000
σ0.000
min7600.000
max7600.000
mean2846.000-2774.000=72.000
σ0.000
min2846.000-2774.000=72.000
max2846.000-2774.000=72.000
mean28.207-27.806=0.401
σ0.662-0.106=0.556
min27.515-27.699=-0.184
max28.987-27.928=1.059