Compare commits

Home / Compare 6e8d2f4a .. d6873d1b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.656=-0.002
σ0.367-0.367=-0.000
min53.508-53.519=-0.011
max54.698-54.701=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.140-0.138=0.001
σ0.006-0.003=0.002
min0.131-0.135=-0.004
max0.151-0.144=0.007
cache=y
dps=1
iters=10
policies=100
mean42.982-42.982=-0.000
σ0.006-0.006=0.000
min42.972-42.973=-0.001
max42.990-42.991=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.118-0.121=-0.003
σ0.004-0.004=0.000
min0.113-0.118=-0.005
max0.125-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.975-1013.973=0.002
σ1.190-1.190=-0.001
min1013.435-1013.430=0.005
max1018.959-1018.957=0.002
mean1052.350-1049.850=2.500
σ307.416-313.214=-5.798
min594.000-559.000=35.000
max1652.000-1521.000=131.000
mean1.618-1.624=-0.006
σ0.074-0.054=0.020
min1.490-1.547=-0.057
max1.815-1.736=0.079

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.151-299.020=0.131
σ0.266-0.202=0.063
min298.995-298.851=0.143
max299.894-299.564=0.330
mean2034.000-1976.000=58.000
σ0.000
min2034.000-1976.000=58.000
max2034.000-1976.000=58.000
mean0.576-0.575=0.001
σ0.016-0.031=-0.016
min0.548-0.537=0.011
max0.593-0.621=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.675-294.676=-0.002
σ0.022-0.020=0.002
min294.642-294.658=-0.016
max294.697-294.705=-0.007
mean1652.000-1521.000=131.000
σ0.000
min1652.000-1521.000=131.000
max1652.000-1521.000=131.000
mean0.391-0.386=0.005
σ0.006-0.009=-0.003
min0.385-0.381=0.004
max0.396-0.401=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1316.945-1316.939=0.005
σ0.093-0.098=-0.005
min1316.893-1316.890=0.003
max1317.111-1317.115=-0.004
mean1652.000-1521.000=131.000
σ0.000
min1652.000-1521.000=131.000
max1652.000-1521.000=131.000
mean1.982-1.945=0.036
σ0.129-0.069=0.061
min1.813-1.857=-0.044
max2.121-2.041=0.080
iters=5
new-facts=6402
prior-facts=1
mean1555.318-1555.289=0.029
σ6.848-6.884=-0.037
min1552.019-1551.961=0.059
max1567.562-1567.598=-0.036
mean1652.000-1521.000=131.000
σ0.000
min1652.000-1521.000=131.000
max1652.000-1521.000=131.000
mean2.352-2.294=0.057
σ0.198-0.272=-0.074
min2.070-2.123=-0.053
max2.609-2.775=-0.166
iters=5
new-facts=6402
prior-facts=6402
mean1884.778-1884.775=0.003
σ0.023-0.011=0.012
min1884.754-1884.763=-0.009
max1884.816-1884.788=0.028
mean1779.400-1749.600=29.800
σ160.813-175.530=-14.717
min1652.000-1522.000=130.000
max2034.000-1976.000=58.000
mean3.056-3.111=-0.055
σ0.154-0.413=-0.259
min2.915-2.867=0.049
max3.253-3.846=-0.593

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.569=-0.407
σ0.215-0.237=-0.022
min0.914-1.224=-0.311
max1.450-1.794=-0.344

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.676-440.668=0.008
σ573.419-573.404=0.014
min153.964-153.964=-0.000
max1300.804-1300.774=0.030
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1521.000=131.000
σ0.000
min1652.000-1521.000=131.000
max1652.000-1521.000=131.000
mean0.549-0.533=0.016
σ0.553-0.539=0.015
min0.269-0.260=0.009
max1.379-1.341=0.038
policies=20
mean1539.918-1539.903=0.015
σ0.319-0.328=-0.009
min1539.729-1539.687=0.042
max1540.395-1540.392=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1521.000=131.000
σ0.000
min1652.000-1521.000=131.000
max1652.000-1521.000=131.000
mean2.614-2.602=0.012
σ0.049-0.018=0.031
min2.571-2.585=-0.014
max2.683-2.624=0.058
policies=200
mean15406.927-15406.971=-0.044
σ0.115-0.028=0.087
min15406.841-15406.931=-0.090
max15407.096-15406.990=0.105
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1521.000=131.000
σ0.000
min1652.000-1521.000=131.000
max1652.000-1521.000=131.000
mean26.286-26.289=-0.003
σ0.201-0.188=0.013
min26.087-26.088=-0.000
max26.535-26.486=0.049