Compare commits

Home / Compare 12114abe .. cd19de68

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.000
σ0.050-0.046=0.003
min31.002-30.999=0.004
max31.179-31.168=0.011
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.079-0.078=0.001
σ0.004-0.003=0.001
min0.076-0.072=0.004
max0.088-0.085=0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.002-0.003=-0.001
min21.139-21.139=0.000
max21.145-21.147=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.062-0.063=-0.001
σ0.004-0.004=0.001
min0.057-0.057=-0.000
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.413=-0.001
σ0.361-0.360=0.001
min1750.845-1750.848=-0.003
max1752.000-1751.976=0.024
mean1654.000-1641.650=12.350
σ646.964-615.828=31.137
min639.000-636.000=3.000
max2850.000-2478.000=372.000
mean2.847-2.852=-0.005
σ0.169-0.148=0.021
min2.453-2.510=-0.058
max3.293-3.055=0.238

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.781-266.785=-0.004
σ0.005-0.010=-0.005
min266.776-266.774=0.003
max266.789-266.796=-0.007
mean2850.000-2478.000=372.000
σ0.000
min2850.000-2478.000=372.000
max2850.000-2478.000=372.000
mean0.368-0.378=-0.010
σ0.006-0.007=-0.001
min0.364-0.374=-0.011
max0.378-0.390=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1927.208-1927.209=-0.000
σ0.007-0.006=0.001
min1927.201-1927.204=-0.003
max1927.215-1927.218=-0.003
mean2850.000-2478.000=372.000
σ0.000
min2850.000-2478.000=372.000
max2850.000-2478.000=372.000
mean3.003-3.019=-0.016
σ0.148-0.065=0.083
min2.856-2.947=-0.091
max3.252-3.116=0.135
iters=5
new-facts=6402
prior-facts=1
mean4747.707-4747.682=0.025
σ0.790-0.890=-0.099
min4747.160-4747.180=-0.020
max4749.107-4749.263=-0.157
mean2850.000-2478.000=372.000
σ0.000
min2850.000-2478.000=372.000
max2850.000-2478.000=372.000
mean8.544-8.704=-0.160
σ0.523-0.599=-0.076
min7.671-7.773=-0.103
max9.039-9.391=-0.352
iters=5
new-facts=6402
prior-facts=6402
mean4938.168-4938.171=-0.003
σ0.089-0.089=-0.001
min4938.093-4938.102=-0.009
max4938.268-4938.270=-0.002
mean3033.800-3016.600=17.200
σ192.073-282.739=-90.666
min2850.000-2623.000=227.000
max3309.000-3330.000=-21.000
mean8.469-8.491=-0.021
σ0.165-0.066=0.099
min8.242-8.412=-0.170
max8.679-8.584=0.095

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.078-1.831=-0.753
σ0.176-0.053=0.123
min0.935-1.767=-0.832
max1.370-1.894=-0.524

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.124-465.114=0.009
σ575.763-575.757=0.006
min177.232-177.233=-0.001
max1328.769-1328.750=0.018
mean79.750
σ7.500
min76.000
max91.000
mean2850.000-2478.000=372.000
σ0.000
min2850.000-2478.000=372.000
max2850.000-2478.000=372.000
mean0.437-0.559=-0.122
σ0.308-0.564=-0.257
min0.281-0.275=0.006
max0.899-1.406=-0.507
policies=20
mean1772.626-1772.589=0.038
σ0.341-0.338=0.003
min1772.366-1772.363=0.003
max1773.124-1773.090=0.034
mean760.000
σ0.000
min760.000
max760.000
mean2850.000-2478.000=372.000
σ0.000
min2850.000-2478.000=372.000
max2850.000-2478.000=372.000
mean2.853-2.752=0.101
σ0.017-0.012=0.005
min2.838-2.743=0.096
max2.877-2.768=0.109
policies=200
mean17732.430-17732.447=-0.017
σ0.536-0.371=0.165
min17732.055-17732.187=-0.132
max17733.204-17732.997=0.207
mean7600.000
σ0.000
min7600.000
max7600.000
mean2850.000-2478.000=372.000
σ0.000
min2850.000-2478.000=372.000
max2850.000-2478.000=372.000
mean28.180-27.725=0.454
σ0.412-0.114=0.298
min27.731-27.576=0.155
max28.548-27.854=0.694