Compare commits

Home / Compare c1d4be8a .. 121ee8c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.654=-0.000
σ0.367-0.367=0.000
min53.517-53.515=0.002
max54.698-54.698=-0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.138-0.138=0.001
σ0.004-0.004=0.000
min0.132-0.132=0.001
max0.145-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-42.981=-0.001
σ0.008-0.006=0.001
min42.972-42.973=-0.000
max42.998-42.989=0.009
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.119-0.119=0.000
σ0.003-0.005=-0.002
min0.117-0.113=0.004
max0.127-0.126=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.977-1013.977=0.000
σ1.168-1.159=0.008
min1013.429-1013.432=-0.003
max1018.863-1018.823=0.041
mean1047.600-1050.150=-2.550
σ315.954-316.754=-0.800
min594.000-597.000=-3.000
max1650.000-1655.000=-5.000
mean1.617-1.611=0.006
σ0.086-0.080=0.006
min1.497-1.519=-0.022
max1.878-1.849=0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.279-299.305=-0.026
σ0.228-0.188=0.041
min299.159-299.174=-0.015
max299.905-299.825=0.081
mean1915.000-1974.000=-59.000
σ0.000
min1915.000-1974.000=-59.000
max1915.000-1974.000=-59.000
mean0.599-0.586=0.013
σ0.040-0.028=0.012
min0.535-0.544=-0.008
max0.680-0.611=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.681-294.682=-0.001
σ0.014-0.021=-0.007
min294.664-294.665=-0.001
max294.695-294.715=-0.020
mean1650.000-1655.000=-5.000
σ0.000
min1650.000-1655.000=-5.000
max1650.000-1655.000=-5.000
mean0.385-0.392=-0.007
σ0.005-0.014=-0.009
min0.380-0.382=-0.001
max0.391-0.412=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1316.947-1316.933=0.013
σ0.103-0.103=-0.000
min1316.848-1316.881=-0.032
max1317.117-1317.118=-0.000
mean1650.000-1655.000=-5.000
σ0.000
min1650.000-1655.000=-5.000
max1650.000-1655.000=-5.000
mean2.021-1.895=0.126
σ0.137-0.103=0.034
min1.904-1.753=0.152
max2.248-2.010=0.238
iters=5
new-facts=6402
prior-facts=1
mean1555.325-1555.316=0.009
σ6.836-6.872=-0.036
min1552.020-1552.000=0.019
max1567.547-1567.603=-0.055
mean1650.000-1655.000=-5.000
σ0.000
min1650.000-1655.000=-5.000
max1650.000-1655.000=-5.000
mean2.402-2.353=0.049
σ0.193-0.214=-0.022
min2.206-2.157=0.048
max2.627-2.657=-0.030
iters=5
new-facts=6402
prior-facts=6402
mean1884.778-1884.785=-0.007
σ0.032-0.036=-0.003
min1884.741-1884.761=-0.020
max1884.829-1884.848=-0.019
mean1774.400-1750.200=24.200
σ133.732-140.249=-6.517
min1650.000-1655.000=-5.000
max1915.000-1974.000=-59.000
mean3.276-3.001=0.275
σ0.426-0.139=0.287
min2.899-2.895=0.004
max3.910-3.199=0.711

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.188=0.031
σ0.325-0.350=-0.025
min0.931-0.908=0.023
max1.631-1.778=-0.147

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.676-440.681=-0.006
σ573.407-573.412=-0.006
min153.968-153.969=-0.001
max1300.786-1300.800=-0.014
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1655.000=-5.000
σ0.000
min1650.000-1655.000=-5.000
max1650.000-1655.000=-5.000
mean0.526-0.551=-0.025
σ0.510-0.561=-0.051
min0.270-0.268=0.002
max1.291-1.393=-0.102
policies=20
mean1539.914-1539.894=0.020
σ0.319-0.302=0.017
min1539.728-1539.724=0.004
max1540.391-1540.347=0.044
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1655.000=-5.000
σ0.000
min1650.000-1655.000=-5.000
max1650.000-1655.000=-5.000
mean2.607-2.583=0.024
σ0.013-0.014=-0.001
min2.591-2.569=0.023
max2.619-2.594=0.024
policies=200
mean15407.049-15406.980=0.069
σ0.053-0.039=0.014
min15406.999-15406.942=0.057
max15407.123-15407.019=0.104
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1655.000=-5.000
σ0.000
min1650.000-1655.000=-5.000
max1650.000-1655.000=-5.000
mean26.331-26.391=-0.059
σ0.120-0.100=0.020
min26.224-26.273=-0.049
max26.459-26.502=-0.043