Compare commits

Home / Compare 1d46a3c0 .. a10f6bd7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.838=-0.000
σ0.365-0.370=-0.005
min53.696-53.692=0.004
max54.876-54.889=-0.013
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.139-0.139=0.000
σ0.004-0.004=-0.000
min0.135-0.136=-0.001
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.209-43.208=0.002
σ0.006-0.007=-0.001
min43.201-43.195=0.006
max43.220-43.218=0.002
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.122-0.119=0.003
σ0.004-0.004=-0.000
min0.119-0.114=0.005
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.202-1016.203=-0.001
σ1.204-1.185=0.019
min1015.663-1015.634=0.030
max1021.253-1021.169=0.084
mean1054.300-1049.150=5.150
σ316.957-311.163=5.794
min547.000-557.000=-10.000
max1629.000-1513.000=116.000
mean1.581-1.516=0.065
σ0.113-0.050=0.063
min1.486-1.451=0.035
max1.939-1.633=0.306

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.362-301.067=0.295
σ0.202-0.317=-0.114
min301.204-300.843=0.362
max301.917-301.945=-0.028
mean2047.000-2042.000=5.000
σ0.000
min2047.000-2042.000=5.000
max2047.000-2042.000=5.000
mean0.556-0.562=-0.007
σ0.033-0.030=0.003
min0.501-0.504=-0.003
max0.584-0.592=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.465-301.484=-0.019
σ0.094-0.044=0.050
min301.303-301.418=-0.115
max301.537-301.538=-0.001
mean1629.000-1513.000=116.000
σ0.000
min1629.000-1513.000=116.000
max1629.000-1513.000=116.000
mean0.404-0.394=0.010
σ0.010-0.007=0.003
min0.392-0.387=0.005
max0.412-0.401=0.011
iters=5
new-facts=1
prior-facts=6402
mean1324.058-1324.056=0.002
σ0.111-0.108=0.002
min1323.924-1323.924=-0.000
max1324.202-1324.200=0.001
mean1629.000-1513.000=116.000
σ0.000
min1629.000-1513.000=116.000
max1629.000-1513.000=116.000
mean1.922-1.938=-0.016
σ0.080-0.105=-0.024
min1.837-1.834=0.003
max2.039-2.058=-0.018
iters=5
new-facts=6402
prior-facts=1
mean1562.077-1562.063=0.014
σ6.949-6.909=0.040
min1558.747-1558.737=0.010
max1574.503-1574.417=0.087
mean1629.000-1513.000=116.000
σ0.000
min1629.000-1513.000=116.000
max1629.000-1513.000=116.000
mean2.267-2.248=0.019
σ0.264-0.220=0.044
min2.097-2.085=0.012
max2.733-2.633=0.100
iters=5
new-facts=6402
prior-facts=6402
mean1891.969-1891.969=0.000
σ0.065-0.065=-0.000
min1891.856-1891.856=0.000
max1892.013-1892.014=-0.000
mean1771.600-1733.800=37.800
σ175.815-213.328=-37.513
min1629.000-1513.000=116.000
max2047.000-2042.000=5.000
mean2.969-3.008=-0.039
σ0.106-0.195=-0.089
min2.885-2.866=0.019
max3.112-3.333=-0.221

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.594=-0.395
σ0.380-0.296=0.084
min0.911-1.229=-0.317
max1.821-1.822=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.945-443.724=0.221
σ575.145-574.722=0.424
min156.362-156.362=0.000
max1306.663-1305.807=0.856
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1513.000=116.000
σ0.000
min1629.000-1513.000=116.000
max1629.000-1513.000=116.000
mean0.549-0.537=0.012
σ0.563-0.548=0.016
min0.265-0.262=0.003
max1.394-1.359=0.035
policies=20
mean1563.903-1563.905=-0.001
σ0.322-0.334=-0.012
min1563.720-1563.693=0.027
max1564.386-1564.403=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1513.000=116.000
σ0.000
min1629.000-1513.000=116.000
max1629.000-1513.000=116.000
mean2.616-2.614=0.003
σ0.013-0.006=0.007
min2.601-2.607=-0.006
max2.633-2.619=0.014
policies=200
mean15646.882-15646.994=-0.111
σ0.181-0.083=0.098
min15646.725-15646.939=-0.214
max15647.113-15647.116=-0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1513.000=116.000
σ0.000
min1629.000-1513.000=116.000
max1629.000-1513.000=116.000
mean26.465-26.454=0.011
σ0.153-0.126=0.028
min26.272-26.321=-0.049
max26.603-26.566=0.037