Compare commits

Home / Compare e8bdd34a .. d135937e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.956=0.001
σ0.103-0.101=0.002
min35.912-35.909=0.003
max36.248-36.241=0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.077-0.077=0.000
σ0.004-0.003=0.001
min0.074-0.074=-0.000
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.204-26.202=0.002
σ0.004-0.003=0.001
min26.197-26.198=-0.001
max26.210-26.208=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.061-0.061=0.000
σ0.003-0.003=-0.000
min0.059-0.059=0.000
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.304-1756.303=0.000
σ0.369-0.370=-0.001
min1755.730-1755.726=0.004
max1756.896-1756.899=-0.004
mean1648.800-1656.900=-8.100
σ628.816-628.968=-0.152
min611.000-673.000=-62.000
max2726.000-2608.000=118.000
mean2.366-2.375=-0.009
σ0.150-0.091=0.059
min2.096-2.273=-0.178
max2.803-2.571=0.232

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.824-278.827=-0.002
σ0.006-0.008=-0.002
min278.817-278.817=-0.001
max278.833-278.839=-0.006
mean2726.000-2608.000=118.000
σ0.000
min2726.000-2608.000=118.000
max2726.000-2608.000=118.000
mean0.412-0.416=-0.004
σ0.005-0.009=-0.004
min0.408-0.406=0.002
max0.418-0.429=-0.010
iters=5
new-facts=1
prior-facts=6402
mean2268.886-2268.891=-0.005
σ0.011-0.006=0.005
min2268.878-2268.884=-0.006
max2268.906-2268.898=0.007
mean2726.000-2608.000=118.000
σ0.000
min2726.000-2608.000=118.000
max2726.000-2608.000=118.000
mean3.067-2.948=0.119
σ0.151-0.116=0.036
min2.890-2.845=0.045
max3.224-3.145=0.079
iters=5
new-facts=6402
prior-facts=1
mean4954.144-4954.290=-0.146
σ1.074-0.933=0.142
min4953.093-4953.712=-0.619
max4955.948-4955.945=0.003
mean2726.000-2608.000=118.000
σ0.000
min2726.000-2608.000=118.000
max2726.000-2608.000=118.000
mean8.124-7.992=0.132
σ0.420-0.352=0.068
min7.675-7.691=-0.016
max8.680-8.592=0.088
iters=5
new-facts=6402
prior-facts=6402
mean5168.829-5168.748=0.081
σ0.094-0.218=-0.124
min5168.725-5168.379=0.346
max5168.907-5168.886=0.021
mean3321.800-3357.400=-35.600
σ391.547-460.637=-69.090
min2933.000-2748.000=185.000
max3716.000-3968.000=-252.000
mean9.475-9.212=0.264
σ0.403-0.437=-0.035
min9.121-8.571=0.549
max10.014-9.714=0.300

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.370=-0.377
σ0.074-0.463=-0.389
min0.929-0.943=-0.014
max1.084-1.911=-0.827

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.812-459.814=-0.002
σ571.578-571.589=-0.011
min174.018-174.017=0.001
max1317.179-1317.198=-0.019
mean79.500
σ7.000
min76.000
max90.000
mean2726.000-2608.000=118.000
σ0.000
min2726.000-2608.000=118.000
max2726.000-2608.000=118.000
mean0.533-0.541=-0.008
σ0.536-0.553=-0.017
min0.265-0.263=0.002
max1.338-1.370=-0.033
policies=20
mean1740.433-1740.403=0.031
σ0.307-0.305=0.002
min1740.252-1740.213=0.039
max1740.893-1740.857=0.035
mean760.000
σ0.000
min760.000
max760.000
mean2726.000-2608.000=118.000
σ0.000
min2726.000-2608.000=118.000
max2726.000-2608.000=118.000
mean2.669-2.671=-0.002
σ0.005-0.012=-0.007
min2.664-2.654=0.011
max2.676-2.682=-0.006
policies=200
mean17411.240-17411.173=0.067
σ0.379-0.590=-0.210
min17411.012-17410.853=0.159
max17411.808-17412.057=-0.249
mean7600.000
σ0.000
min7600.000
max7600.000
mean2726.000-2608.000=118.000
σ0.000
min2726.000-2608.000=118.000
max2726.000-2608.000=118.000
mean26.927-27.053=-0.126
σ0.089-0.112=-0.022
min26.847-26.957=-0.110
max27.053-27.193=-0.140