Compare commits

Home / Compare 17411a38 .. f1b00cf4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.330-1755.329=0.001
σ0.368-0.366=0.001
min1754.753-1754.754=-0.001
max1755.915-1755.914=0.001
mean1660.800-1647.050=13.750
σ623.278-624.780=-1.502
min682.000-612.000=70.000
max2653.000-2649.000=4.000
mean2.265-2.259=0.006
σ0.099-0.105=-0.007
min2.143-2.077=0.065
max2.512-2.470=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.719-277.719=0.000
σ0.008-0.008=0.000
min277.708-277.708=0.000
max277.730-277.729=0.001
mean2653.000-2649.000=4.000
σ0.000
min2653.000-2649.000=4.000
max2653.000-2649.000=4.000
mean0.409-0.407=0.003
σ0.001-0.002=-0.001
min0.409-0.404=0.005
max0.410-0.408=0.002
iters=5
new-facts=1
prior-facts=6402
mean2267.869-2267.892=-0.022
σ0.016-0.012=0.004
min2267.850-2267.881=-0.031
max2267.888-2267.910=-0.022
mean2653.000-2649.000=4.000
σ0.000
min2653.000-2649.000=4.000
max2653.000-2649.000=4.000
mean3.235-3.079=0.157
σ0.196-0.229=-0.033
min2.930-2.739=0.191
max3.437-3.333=0.104
iters=5
new-facts=6402
prior-facts=1
mean4955.056-4954.921=0.135
σ0.819-0.927=-0.108
min4954.595-4954.069=0.526
max4956.514-4956.501=0.014
mean2653.000-2649.000=4.000
σ0.000
min2653.000-2649.000=4.000
max2653.000-2649.000=4.000
mean7.919-7.924=-0.004
σ0.290-0.318=-0.028
min7.642-7.635=0.007
max8.323-8.389=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean5169.646-5169.787=-0.141
σ0.222-0.086=0.136
min5169.343-5169.693=-0.349
max5169.852-5169.855=-0.003
mean3359.200-3374.000=-14.800
σ451.646-518.675=-67.029
min2919.000-2909.000=10.000
max3821.000-4117.000=-296.000
mean9.364-9.102=0.263
σ0.136-0.163=-0.027
min9.138-8.870=0.268
max9.474-9.301=0.172

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.591-1.028=0.562
σ0.303-0.133=0.170
min1.247-0.938=0.309
max1.859-1.244=0.615

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean456.323-456.318=0.006
σ572.604-572.593=0.011
min170.019-170.021=-0.002
max1315.230-1315.207=0.023
mean79.500
σ7.000
min76.000
max90.000
mean431.000-431.500=-0.500
σ0.000-0.577=-0.577
min431.000
max431.000-432.000=-1.000
mean0.575-0.545=0.030
σ0.605-0.552=0.052
min0.272-0.261=0.011
max1.482-1.373=0.109
policies=20
mean1700.733-1700.725=0.008
σ0.311-0.293=0.018
min1700.503-1700.508=-0.005
max1701.187-1701.153=0.035
mean760.000
σ0.000
min760.000
max760.000
mean444.000-444.500=-0.500
σ11.804-11.240=0.564
min431.000-432.000=-1.000
max454.000
mean2.630-2.604=0.026
σ0.024-0.024=-0.000
min2.608-2.581=0.027
max2.661-2.628=0.033
policies=200
mean17016.735-17016.556=0.179
σ0.061-0.045=0.015
min17016.657-17016.499=0.157
max17016.801-17016.598=0.203
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.750-491.750=-2.000
σ3.775-2.062=1.713
min486.000-489.000=-3.000
max493.000-494.000=-1.000
mean26.528-26.279=0.249
σ0.087-0.071=0.016
min26.412-26.213=0.199
max26.613-26.379=0.234