Compare commits

Home / Compare 53ed13de .. c9fa4ccf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.033=-0.003
σ0.370-0.368=0.002
min53.884-53.885=-0.001
max55.083-55.080=0.003
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.138-0.141=-0.003
σ0.006-0.004=0.001
min0.132-0.137=-0.006
max0.151-0.147=0.004
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.007-0.008=-0.001
min43.373-43.371=0.002
max43.396-43.398=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.123-0.123=0.000
σ0.003-0.004=-0.000
min0.120-0.120=0.000
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.336-1006.333=0.003
σ0.877-0.877=-0.000
min1005.835-1005.836=-0.001
max1009.956-1009.969=-0.014
mean1048.200-1051.100=-2.900
σ306.862-306.879=-0.017
min573.000-575.000=-2.000
max1643.000-1646.000=-3.000
mean1.566-1.533=0.033
σ0.099-0.058=0.041
min1.486-1.473=0.013
max1.865-1.669=0.197

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.884=-0.002
σ0.002-0.002=0.000
min0.881-0.883=-0.001
max0.886-0.886=-0.001
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.423-0.435=-0.013
σ0.127-0.166=-0.039
min0.335-0.326=0.009
max0.635-0.730=-0.095
name=error_case.art
mean2.334-2.334=0.000
σ0.003-0.002=0.000
min2.332
max2.337
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.886-0.920=-0.034
σ0.080-0.167=-0.086
min0.827-0.819=0.008
max1.026-1.216=-0.190
name=heavy_item.art
mean1.521-1.522=-0.001
σ0.001-0.001=-0.000
min1.520
max1.523-1.524=-0.001
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.539-0.539=-0.000
σ0.057-0.049=0.008
min0.497-0.495=0.001
max0.635-0.622=0.012
name=nested_use.art
mean2.356-2.356=0.000
σ0.002-0.002=0.000
min2.355
max2.358
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.849-0.846=0.002
σ0.046-0.029=0.017
min0.815-0.827=-0.011
max0.927-0.897=0.031

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.557-963.555=0.002
σ0.031-0.026=0.005
min963.532-963.532=-0.000
max963.609-963.599=0.010
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.811-0.806=0.006
σ0.050-0.048=0.002
min0.751-0.740=0.011
max0.863-0.851=0.012
name=cdr_enhanced_4k_loc.art
mean884.856-884.855=0.001
σ0.005-0.007=-0.001
min884.848
max884.862-884.865=-0.003
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.724-0.710=0.014
σ0.024-0.052=-0.028
min0.691-0.622=0.069
max0.755-0.744=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.710=-0.001
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean4.269-4.268=0.001
σ0.084-0.093=-0.009
min4.130-4.123=0.006
max4.737-4.514=0.223
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.658-7.658=0.000
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean4.269-4.219=0.050
σ0.101-0.131=-0.030
min4.118-3.472=0.646
max4.908-4.541=0.367
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.746-0.741=0.005
σ0.029-0.023=0.007
min0.711-0.692=0.019
max0.941-0.871=0.069
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.708-0.683=0.025
σ0.016-0.014=0.001
min0.678-0.659=0.018
max0.800-0.766=0.033

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.468-295.409=0.059
σ0.202-0.209=-0.007
min295.287-295.218=0.069
max296.021-295.967=0.054
mean1891.000-1911.000=-20.000
σ0.000
min1891.000-1911.000=-20.000
max1891.000-1911.000=-20.000
mean0.581-0.571=0.011
σ0.034-0.044=-0.011
min0.510-0.507=0.002
max0.611-0.644=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.247-285.250=-0.003
σ0.036-0.040=-0.003
min285.200-285.199=0.001
max285.285-285.290=-0.005
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.383-0.393=-0.010
σ0.001-0.012=-0.011
min0.382-0.380=0.002
max0.384-0.409=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1295.191-1295.197=-0.006
σ0.107-0.113=-0.006
min1295.075-1295.067=0.008
max1295.309-1295.332=-0.023
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean1.925-1.904=0.021
σ0.117-0.080=0.037
min1.815-1.809=0.006
max2.100-1.992=0.108
iters=5
new-facts=6402
prior-facts=1
mean1538.098-1538.065=0.033
σ4.048-4.027=0.021
min1536.040-1536.046=-0.006
max1545.327-1545.260=0.066
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean2.312-2.268=0.044
σ0.354-0.203=0.151
min2.016-2.017=-0.001
max2.789-2.473=0.317
iters=5
new-facts=6402
prior-facts=6402
mean1857.103-1857.107=-0.004
σ0.053-0.051=0.002
min1857.057-1857.056=0.000
max1857.183-1857.175=0.008
mean1771.400-1782.600=-11.200
σ121.115-131.146=-10.031
min1643.000-1646.000=-3.000
max1891.000-1911.000=-20.000
mean3.049-3.057=-0.008
σ0.221-0.227=-0.006
min2.860-2.875=-0.015
max3.429-3.450=-0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.298-1.294=0.004
σ0.181-0.261=-0.080
min1.110-1.107=0.003
max1.598-1.738=-0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.612-443.607=0.005
σ577.066-577.065=0.000
min155.076-155.074=0.002
max1309.210-1309.205=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean0.537-0.562=-0.025
σ0.547-0.590=-0.043
min0.262-0.263=-0.000
max1.358-1.447=-0.089
policies=20
mean1551.061-1551.015=0.047
σ0.331-0.321=0.010
min1550.838-1550.791=0.047
max1551.553-1551.491=0.063
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean2.599-2.579=0.021
σ0.011-0.009=0.001
min2.584-2.571=0.013
max2.607-2.592=0.015
policies=200
mean15518.597-15518.506=0.090
σ0.117-0.162=-0.045
min15518.477-15518.342=0.135
max15518.756-15518.708=0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1646.000=-3.000
σ0.000
min1643.000-1646.000=-3.000
max1643.000-1646.000=-3.000
mean26.203-26.075=0.127
σ0.187-0.049=0.138
min26.073-26.015=0.058
max26.477-26.121=0.356