Compare commits

Home / Compare caa9cf4e .. f4b81960

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.709=0.127
σ0.368-0.364=0.005
min53.691-53.577=0.114
max54.884-54.743=0.141
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.139-0.138=0.001
σ0.004-0.003=0.001
min0.134-0.135=-0.001
max0.147-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean43.208-42.978=0.230
σ0.006-0.004=0.002
min43.195-42.971=0.224
max43.219-42.987=0.231
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.121=-0.001
σ0.005-0.003=0.002
min0.114-0.118=-0.004
max0.130-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-995.211=20.993
σ1.159-1.226=-0.067
min1015.655-994.624=21.031
max1021.054-1000.354=20.700
mean1042.050-1056.200=-14.150
σ310.174-307.831=2.342
min588.000-619.000=-31.000
max1629.000-1509.000=120.000
mean1.544-1.510=0.033
σ0.106-0.102=0.004
min1.440-1.392=0.048
max1.808-1.786=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.298
σ0.208
min301.151
max301.868
mean2036.000
σ0.000
min2036.000
max2036.000
mean0.546
σ0.038
min0.504
max0.588

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.475-297.322=4.153
σ0.060-0.004=0.056
min301.379-297.317=4.063
max301.530-297.328=4.203
mean1629.000-1509.000=120.000
σ0.000
min1629.000-1509.000=120.000
max1629.000-1509.000=120.000
mean0.394-0.389=0.004
σ0.004-0.002=0.002
min0.390-0.387=0.003
max0.400-0.392=0.007
iters=5
new-facts=1
prior-facts=6402
mean1324.055-1299.030=25.024
σ0.104-0.055=0.049
min1323.924-1298.940=24.984
max1324.190-1299.074=25.116
mean1629.000-1509.000=120.000
σ0.000
min1629.000-1509.000=120.000
max1629.000-1509.000=120.000
mean1.906-1.876=0.030
σ0.105-0.029=0.076
min1.816-1.846=-0.030
max2.076-1.911=0.164
iters=5
new-facts=6402
prior-facts=1
mean1562.106-1719.183=-157.077
σ6.924-6.937=-0.012
min1558.792-1715.942=-157.150
max1574.489-1731.587=-157.099
mean1629.000-1509.000=120.000
σ0.000
min1629.000-1509.000=120.000
max1629.000-1509.000=120.000
mean2.409-3.004=-0.595
σ0.377-0.458=-0.081
min2.003-2.494=-0.490
max2.846-3.729=-0.883
iters=5
new-facts=6402
prior-facts=6402
mean1891.965-1981.922=-89.956
σ0.067-0.040=0.027
min1891.850-1981.853=-90.003
max1892.006-1981.953=-89.947
mean1769.000-1784.800=-15.800
σ171.504-201.920=-30.416
min1629.000-1537.000=92.000
max2036.000-2056.000=-20.000
mean2.893-3.326=-0.433
σ0.071-0.380=-0.309
min2.841-3.088=-0.246
max3.017-3.999=-0.982

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.595=-0.389
σ0.373-0.294=0.079
min0.900-1.241=-0.340
max1.817-1.833=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.493-440.448=3.044
σ574.238-573.026=1.212
min156.362-153.929=2.433
max1304.849-1299.988=4.862
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1629.000-1509.000=120.000
σ0.000
min1629.000-1509.000=120.000
max1629.000-1509.000=120.000
mean0.536-0.538=-0.002
σ0.553-0.563=-0.010
min0.259-0.255=0.003
max1.365-1.382=-0.017
policies=20
mean1563.920-1539.583=24.336
σ0.329-0.296=0.033
min1563.734-1539.383=24.350
max1564.412-1540.022=24.390
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1629.000-1509.000=120.000
σ0.000
min1629.000-1509.000=120.000
max1629.000-1509.000=120.000
mean2.621-2.555=0.065
σ0.011-0.011=-0.000
min2.611-2.541=0.070
max2.635-2.565=0.070
policies=200
mean15646.995-15404.073=242.923
σ0.054-0.091=-0.037
min15646.939-15403.955=242.984
max15647.061-15404.160=242.901
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1629.000-1509.000=120.000
σ0.000
min1629.000-1509.000=120.000
max1629.000-1509.000=120.000
mean26.494-26.018=0.476
σ0.177-0.122=0.055
min26.286-25.910=0.376
max26.680-26.162=0.517