Compare commits

Home / Compare b95d5bd3 .. 252da65e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.050-0.049=0.001
min31.004-31.003=0.001
max31.179-31.176=0.004
mean412.000-413.200=-1.200
σ0.000-0.422=-0.422
min412.000-413.000=-1.000
max412.000-414.000=-2.000
mean0.075-0.080=-0.005
σ0.006-0.003=0.003
min0.071-0.077=-0.006
max0.087-0.087=0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.002=0.001
min21.139-21.140=-0.001
max21.149-21.147=0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.064=0.000
σ0.002-0.003=-0.001
min0.063-0.059=0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.412=0.001
σ0.363-0.362=0.000
min1750.845-1750.845=0.000
max1751.996-1751.996=0.000
mean1652.900-1637.600=15.300
σ645.480-615.405=30.075
min629.000-631.000=-2.000
max2848.000-2473.000=375.000
mean2.902-2.843=0.059
σ0.106-0.151=-0.045
min2.641-2.506=0.135
max3.081-3.027=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.762-266.765=-0.003
σ0.008-0.015=-0.007
min266.749-266.752=-0.002
max266.771-266.790=-0.020
mean2848.000-2473.000=375.000
σ0.000
min2848.000-2473.000=375.000
max2848.000-2473.000=375.000
mean0.379-0.375=0.004
σ0.008-0.002=0.006
min0.374-0.373=0.001
max0.389-0.377=0.012
iters=5
new-facts=1
prior-facts=6402
mean1927.209-1927.220=-0.012
σ0.010-0.014=-0.004
min1927.193-1927.206=-0.013
max1927.218-1927.236=-0.018
mean2848.000-2473.000=375.000
σ0.000
min2848.000-2473.000=375.000
max2848.000-2473.000=375.000
mean2.887-2.915=-0.028
σ0.248-0.255=-0.006
min2.458-2.476=-0.018
max3.079-3.126=-0.046
iters=5
new-facts=6402
prior-facts=1
mean4747.600-4747.726=-0.126
σ0.942-0.816=0.126
min4746.717-4747.315=-0.598
max4749.207-4749.184=0.023
mean2848.000-2473.000=375.000
σ0.000
min2848.000-2473.000=375.000
max2848.000-2473.000=375.000
mean8.530-8.322=0.208
σ0.663-0.680=-0.017
min7.637-7.697=-0.060
max9.456-9.112=0.343
iters=5
new-facts=6402
prior-facts=6402
mean4938.167-4938.088=0.079
σ0.093-0.124=-0.031
min4938.080-4937.899=0.181
max4938.269-4938.247=0.022
mean3029.000-2942.200=86.800
σ192.514-408.109=-215.596
min2848.000-2483.000=365.000
max3311.000-3483.000=-172.000
mean8.654-8.462=0.191
σ0.222-0.075=0.147
min8.389-8.414=-0.025
max8.991-8.595=0.396

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.008-1.776=-0.769
σ0.142-0.060=0.082
min0.942-1.704=-0.762
max1.262-1.853=-0.591

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.122-465.107=0.015
σ575.754-575.754=0.000
min177.235-177.230=0.005
max1328.753-1328.738=0.015
mean79.750
σ7.500
min76.000
max91.000
mean2848.000-2473.000=375.000
σ0.000
min2848.000-2473.000=375.000
max2848.000-2473.000=375.000
mean0.445-0.550=-0.105
σ0.303-0.539=-0.236
min0.286-0.276=0.011
max0.900-1.359=-0.459
policies=20
mean1772.637-1772.547=0.090
σ0.329-0.340=-0.010
min1772.403-1772.325=0.078
max1773.121-1773.051=0.070
mean760.000
σ0.000
min760.000
max760.000
mean2848.000-2473.000=375.000
σ0.000
min2848.000-2473.000=375.000
max2848.000-2473.000=375.000
mean2.840-2.744=0.096
σ0.007-0.023=-0.016
min2.832-2.726=0.106
max2.846-2.777=0.069
policies=200
mean17732.429-17732.408=0.021
σ0.560-0.556=0.004
min17732.086-17732.034=0.052
max17733.262-17733.214=0.048
mean7600.000
σ0.000
min7600.000
max7600.000
mean2848.000-2473.000=375.000
σ0.000
min2848.000-2473.000=375.000
max2848.000-2473.000=375.000
mean28.239-27.746=0.493
σ0.509-0.104=0.406
min27.684-27.639=0.044
max28.677-27.880=0.797