Compare commits

Home / Compare 837690d8 .. bc4ac7c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.951-35.951=-0.000
σ0.102-0.104=-0.002
min35.907-35.911=-0.005
max36.240-36.246=-0.006
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.077-0.076=0.001
σ0.004-0.003=0.001
min0.074-0.074=0.000
max0.084-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean26.200-26.200=0.000
σ0.003-0.005=-0.001
min26.196-26.195=0.002
max26.206-26.209=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.061-0.062=-0.001
σ0.003-0.004=-0.001
min0.059-0.060=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.305-1756.303=0.002
σ0.368-0.367=0.000
min1755.727-1755.728=-0.001
max1756.894-1756.898=-0.004
mean1659.100-1656.800=2.300
σ631.215-637.856=-6.640
min613.000-609.000=4.000
max2729.000-2691.000=38.000
mean2.411-2.441=-0.029
σ0.121-0.190=-0.069
min2.241-2.223=0.018
max2.775-3.163=-0.388

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.822-278.824=-0.001
σ0.004-0.008=-0.004
min278.816-278.810=0.007
max278.826-278.830=-0.004
mean2729.000-2691.000=38.000
σ0.000
min2729.000-2691.000=38.000
max2729.000-2691.000=38.000
mean0.409-0.411=-0.003
σ0.007-0.005=0.002
min0.398-0.408=-0.011
max0.416-0.420=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.882-2268.875=0.007
σ0.011-0.015=-0.005
min2268.871-2268.854=0.018
max2268.898-2268.895=0.004
mean2729.000-2691.000=38.000
σ0.000
min2729.000-2691.000=38.000
max2729.000-2691.000=38.000
mean2.957-3.018=-0.061
σ0.055-0.143=-0.088
min2.900-2.933=-0.032
max3.028-3.271=-0.244
iters=5
new-facts=6402
prior-facts=1
mean4954.244-4954.118=0.126
σ0.890-0.967=-0.077
min4953.721-4953.286=0.435
max4955.825-4955.790=0.035
mean2729.000-2691.000=38.000
σ0.000
min2729.000-2691.000=38.000
max2729.000-2691.000=38.000
mean8.093-8.074=0.019
σ0.439-0.400=0.038
min7.759-7.685=0.074
max8.780-8.714=0.066
iters=5
new-facts=6402
prior-facts=6402
mean5168.782-5168.722=0.060
σ0.080-0.120=-0.040
min5168.722-5168.536=0.186
max5168.888-5168.870=0.018
mean3378.000-3413.000=-35.000
σ450.943-448.939=2.004
min2770.000-2816.000=-46.000
max3956.000-3995.000=-39.000
mean9.239-9.588=-0.349
σ0.187-0.340=-0.153
min9.049-9.057=-0.008
max9.444-9.967=-0.523

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.234=-0.205
σ0.170-0.282=-0.112
min0.945-1.054=-0.109
max1.332-1.720=-0.388

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.818-459.817=0.002
σ571.587-571.592=-0.005
min174.019-174.013=0.006
max1317.199-1317.205=-0.006
mean79.500
σ7.000
min76.000
max90.000
mean2729.000-2691.000=38.000
σ0.000
min2729.000-2691.000=38.000
max2729.000-2691.000=38.000
mean0.536-0.540=-0.005
σ0.535-0.542=-0.006
min0.266-0.266=-0.000
max1.339-1.353=-0.014
policies=20
mean1740.406-1740.407=-0.001
σ0.320-0.326=-0.007
min1740.200-1740.201=-0.001
max1740.882-1740.894=-0.011
mean760.000
σ0.000
min760.000
max760.000
mean2729.000-2691.000=38.000
σ0.000
min2729.000-2691.000=38.000
max2729.000-2691.000=38.000
mean2.682-2.681=0.001
σ0.014-0.050=-0.036
min2.669-2.613=0.056
max2.698-2.732=-0.033
policies=200
mean17410.914-17410.916=-0.002
σ0.542-0.576=-0.034
min17410.612-17410.578=0.034
max17411.725-17411.776=-0.051
mean7600.000
σ0.000
min7600.000
max7600.000
mean2729.000-2691.000=38.000
σ0.000
min2729.000-2691.000=38.000
max2729.000-2691.000=38.000
mean27.007-27.087=-0.080
σ0.050-0.181=-0.131
min26.951-26.860=0.091
max27.068-27.278=-0.211