Compare commits

Home / Compare fd08dda3 .. 547e753c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=0.000
σ0.049-0.049=0.000
min31.004-31.000=0.004
max31.178-31.177=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.079-0.079=-0.000
σ0.003-0.003=-0.000
min0.077-0.076=0.001
max0.086-0.086=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.003-0.003=0.000
min21.137-21.138=-0.001
max21.147-21.147=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.065=-0.001
σ0.003-0.003=-0.000
min0.059-0.063=-0.003
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.414-1751.411=0.003
σ0.363-0.360=0.003
min1750.848-1750.841=0.007
max1751.992-1751.974=0.019
mean1638.400-1651.400=-13.000
σ613.900-644.853=-30.954
min628.000-631.000=-3.000
max2468.000-2855.000=-387.000
mean2.806-2.740=0.065
σ0.180-0.216=-0.036
min2.376-2.262=0.114
max3.156-3.022=0.134

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.782-266.787=-0.005
σ0.005-0.012=-0.007
min266.773-266.771=0.002
max266.786-266.805=-0.019
mean2468.000-2855.000=-387.000
σ0.000
min2468.000-2855.000=-387.000
max2468.000-2855.000=-387.000
mean0.364-0.359=0.005
σ0.001-0.011=-0.010
min0.363-0.338=0.024
max0.365-0.364=0.000
iters=5
new-facts=1
prior-facts=6402
mean1927.208-1927.213=-0.005
σ0.011-0.003=0.009
min1927.194-1927.210=-0.017
max1927.221-1927.217=0.004
mean2468.000-2855.000=-387.000
σ0.000
min2468.000-2855.000=-387.000
max2468.000-2855.000=-387.000
mean2.960-2.921=0.039
σ0.087-0.157=-0.071
min2.816-2.708=0.107
max3.045-3.122=-0.077
iters=5
new-facts=6402
prior-facts=1
mean4747.638-4747.764=-0.125
σ0.876-0.826=0.050
min4746.821-4747.279=-0.458
max4749.136-4749.229=-0.092
mean2468.000-2855.000=-387.000
σ0.000
min2468.000-2855.000=-387.000
max2468.000-2855.000=-387.000
mean8.197-8.360=-0.163
σ0.393-0.913=-0.520
min7.768-7.569=0.199
max8.672-9.713=-1.041
iters=5
new-facts=6402
prior-facts=6402
mean4938.101-4938.159=-0.057
σ0.202-0.081=0.121
min4937.768-4938.085=-0.318
max4938.262-4938.251=0.012
mean2910.400-3078.800=-168.400
σ396.832-302.123=94.709
min2468.000-2855.000=-387.000
max3449.000-3550.000=-101.000
mean8.402-8.466=-0.064
σ0.112-0.235=-0.122
min8.306-8.285=0.021
max8.596-8.826=-0.230

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.809-1.069=0.741
σ0.089-0.114=-0.025
min1.664-0.929=0.735
max1.901-1.246=0.655

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.115-465.119=-0.004
σ575.751-575.755=-0.003
min177.237-177.234=0.002
max1328.742-1328.751=-0.009
mean79.750
σ7.500
min76.000
max91.000
mean2468.000-2855.000=-387.000
σ0.000
min2468.000-2855.000=-387.000
max2468.000-2855.000=-387.000
mean0.572-0.441=0.130
σ0.579-0.305=0.275
min0.276-0.288=-0.012
max1.440-0.898=0.542
policies=20
mean1772.604-1772.618=-0.014
σ0.322-0.328=-0.007
min1772.388-1772.379=0.008
max1773.081-1773.100=-0.019
mean760.000
σ0.000
min760.000
max760.000
mean2468.000-2855.000=-387.000
σ0.000
min2468.000-2855.000=-387.000
max2468.000-2855.000=-387.000
mean2.726-2.824=-0.098
σ0.014-0.006=0.009
min2.710-2.816=-0.106
max2.744-2.829=-0.085
policies=200
mean17732.580-17732.562=0.018
σ0.517-0.510=0.007
min17732.172-17732.211=-0.040
max17733.328-17733.319=0.009
mean7600.000
σ0.000
min7600.000
max7600.000
mean2468.000-2855.000=-387.000
σ0.000
min2468.000-2855.000=-387.000
max2468.000-2855.000=-387.000
mean27.593-28.088=-0.495
σ0.149-0.455=-0.306
min27.453-27.654=-0.201
max27.802-28.593=-0.791