Compare commits

Home / Compare e9fa2f14 .. 9390a7b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.107=-0.051
σ0.371-0.369=0.001
min53.909-53.962=-0.053
max55.109-55.156=-0.047
mean418.000-418.700=-0.700
σ0.000-0.483=-0.483
min418.000
max418.000-419.000=-1.000
mean0.143-0.139=0.004
σ0.004-0.004=-0.001
min0.137-0.131=0.006
max0.149-0.147=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.006-0.007=-0.000
min43.385-43.389=-0.004
max43.407-43.411=-0.004
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.125-0.123=0.002
σ0.004-0.003=0.001
min0.121-0.119=0.002
max0.131-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1006.796=0.210
σ1.188-1.198=-0.010
min1006.434-1006.231=0.203
max1011.983-1011.823=0.161
mean1053.150-1053.800=-0.650
σ307.903-308.911=-1.008
min578.000
max1645.000-1651.000=-6.000
mean1.555-1.545=0.010
σ0.094-0.076=0.019
min1.470-1.467=0.003
max1.828-1.791=0.037

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.473-0.427=0.046
σ0.144-0.160=-0.017
min0.351-0.342=0.009
max0.658-0.713=-0.055
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.878-0.907=-0.030
σ0.089-0.133=-0.044
min0.803-0.819=-0.017
max1.032-1.142=-0.110
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.556-0.558=-0.003
σ0.048-0.041=0.007
min0.521-0.529=-0.008
max0.636-0.630=0.006
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.866-0.837=0.029
σ0.064-0.044=0.020
min0.819-0.800=0.019
max0.967-0.909=0.058

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.113=0.722
σ0.031-0.023=0.008
min964.802-964.095=0.707
max964.886-964.151=0.735
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.845-0.838=0.007
σ0.019-0.035=-0.016
min0.813-0.792=0.021
max0.863-0.877=-0.014
name=cdr_enhanced_4k_loc.art
mean885.513-884.714=0.799
σ0.005-0.001=0.004
min885.504-884.713=0.791
max885.516-884.715=0.802
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.719-0.666=0.053
σ0.032-0.070=-0.038
min0.674-0.574=0.100
max0.746-0.724=0.022

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.714=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.722-7.718=0.004
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean3.512-4.244=-0.732
σ0.091-0.091=-0.000
min3.381-3.714=-0.333
max3.800-4.581=-0.782
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean3.482-4.215=-0.733
σ0.076-0.072=0.004
min3.349-4.103=-0.754
max3.773-4.459=-0.686
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.630-0.739=-0.109
σ0.104-0.017=0.087
min0.513-0.706=-0.193
max0.839-0.847=-0.008
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.505-0.701=-0.196
σ0.011-0.014=-0.003
min0.483-0.674=-0.190
max0.545-0.753=-0.208

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.224-296.819=0.405
σ0.217-0.220=-0.003
min297.020-296.671=0.349
max297.773-297.423=0.350
mean1892.000-1897.000=-5.000
σ0.000
min1892.000-1897.000=-5.000
max1892.000-1897.000=-5.000
mean0.587-0.593=-0.006
σ0.036-0.050=-0.014
min0.505-0.529=-0.025
max0.647-0.715=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.828-286.488=0.340
σ0.035-0.037=-0.002
min286.788-286.439=0.349
max286.871-286.526=0.345
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.399-0.403=-0.004
σ0.009-0.007=0.002
min0.390-0.397=-0.008
max0.411-0.412=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.257-1296.839=0.419
σ0.116-0.105=0.010
min1297.095-1296.759=0.336
max1297.397-1297.012=0.385
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean2.193-1.944=0.249
σ0.078-0.170=-0.092
min2.060-1.808=0.253
max2.267-2.231=0.036
iters=5
new-facts=6402
prior-facts=1
mean1541.430-1541.045=0.385
σ6.799-6.840=-0.042
min1538.274-1537.871=0.403
max1553.590-1553.280=0.310
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean2.450-2.341=0.109
σ0.205-0.270=-0.066
min2.197-2.129=0.068
max2.749-2.689=0.060
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1858.788=0.326
σ0.066-0.057=0.009
min1859.024-1858.730=0.294
max1859.192-1858.862=0.330
mean1774.800-1769.200=5.600
σ120.265-122.156=-1.891
min1645.000-1651.000=-6.000
max1892.000-1897.000=-5.000
mean3.014-3.075=-0.060
σ0.160-0.255=-0.095
min2.844-2.863=-0.019
max3.275-3.506=-0.231

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.310-1.132=0.178
σ0.306-0.240=0.066
min1.053-0.934=0.120
max1.760-1.490=0.271

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.415=0.405
σ581.372-581.253=0.119
min158.133-157.786=0.346
max1320.879-1320.295=0.584
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean0.584-0.565=0.019
σ0.630-0.607=0.023
min0.268-0.253=0.014
max1.529-1.475=0.054
policies=20
mean1581.613-1578.160=3.453
σ0.360-0.356=0.004
min1581.367-1577.920=3.447
max1582.148-1578.690=3.458
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean2.645-2.643=0.003
σ0.010-0.022=-0.012
min2.635-2.617=0.018
max2.659-2.665=-0.006
policies=200
mean15824.219-15789.493=34.726
σ0.137-0.189=-0.052
min15824.032-15789.328=34.705
max15824.362-15789.764=34.598
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1651.000=-6.000
σ0.000
min1645.000-1651.000=-6.000
max1645.000-1651.000=-6.000
mean26.678-26.692=-0.014
σ0.057-0.074=-0.016
min26.613-26.626=-0.014
max26.738-26.791=-0.053