Compare commits

Home / Compare 5d80b09e .. 9a0ea53d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.369-0.368=0.001
min53.867-53.869=-0.001
max55.064-55.061=0.004
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.136-0.132=0.004
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.323-43.325=-0.002
σ0.007-0.005=0.002
min43.313-43.319=-0.005
max43.335-43.333=0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.124-0.125=-0.001
σ0.004-0.005=-0.001
min0.120-0.119=0.001
max0.129-0.135=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.309=-0.004
σ1.198-1.175=0.023
min1005.771-1005.764=0.007
max1011.336-1011.227=0.109
mean1047.550-1043.500=4.050
σ305.266-312.030=-6.764
min587.000-595.000=-8.000
max1638.000-1633.000=5.000
mean1.558-1.554=0.005
σ0.070-0.078=-0.008
min1.492-1.471=0.021
max1.746-1.789=-0.043

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.396-0.407=-0.011
σ0.103-0.144=-0.041
min0.337-0.323=0.014
max0.578-0.661=-0.083
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.893-0.906=-0.013
σ0.086-0.103=-0.017
min0.837-0.805=0.032
max1.045-1.056=-0.011
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.545-0.534=0.011
σ0.047-0.044=0.003
min0.504-0.490=0.014
max0.621-0.603=0.018
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.849-0.834=0.015
σ0.036-0.039=-0.003
min0.825-0.793=0.032
max0.912-0.897=0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.001
σ0.032-0.035=-0.003
min964.087-964.087=0.001
max964.167-964.172=-0.006
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.838-0.795=0.044
σ0.027-0.033=-0.006
min0.791-0.762=0.030
max0.858-0.846=0.012
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.000
σ0.007-0.008=-0.001
min884.705-884.703=0.001
max884.721-884.722=-0.001
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.706-0.714=-0.009
σ0.042-0.025=0.017
min0.663-0.683=-0.020
max0.759-0.745=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.722-7.718=0.004
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean4.246-4.272=-0.025
σ0.090-0.079=0.011
min4.117-4.140=-0.023
max4.611-4.525=0.086
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean4.244-4.259=-0.015
σ0.077-0.085=-0.008
min4.132-4.108=0.024
max4.525-4.573=-0.048
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.743-0.740=0.002
σ0.027-0.022=0.005
min0.533-0.708=-0.176
max0.824-0.871=-0.047
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.698-0.707=-0.010
σ0.014-0.015=-0.000
min0.670-0.678=-0.009
max0.784-0.777=0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.273-296.314=-0.042
σ0.220-0.239=-0.020
min296.125-296.131=-0.006
max296.875-296.931=-0.055
mean1907.000-1916.000=-9.000
σ0.000
min1907.000-1916.000=-9.000
max1907.000-1916.000=-9.000
mean0.597-0.581=0.016
σ0.024-0.042=-0.018
min0.563-0.524=0.039
max0.654-0.684=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.698=-0.001
σ0.035-0.029=0.006
min284.656-284.665=-0.010
max284.738-284.733=0.005
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.396-0.397=-0.001
σ0.011-0.010=0.001
min0.384-0.386=-0.002
max0.405-0.407=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.076=0.004
σ0.109-0.107=0.002
min1294.961-1294.962=-0.001
max1295.214-1295.206=0.007
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean1.909-1.917=-0.008
σ0.083-0.097=-0.014
min1.816-1.817=-0.000
max2.002-2.050=-0.048
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.185=0.004
σ6.865-6.869=-0.004
min1535.936-1535.935=0.001
max1551.466-1551.469=-0.003
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean2.274-2.261=0.014
σ0.247-0.252=-0.005
min2.027-2.016=0.012
max2.542-2.554=-0.012
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.988=0.003
σ0.056-0.054=0.002
min1856.925-1856.931=-0.005
max1857.067-1857.063=0.004
mean1775.200-1773.200=2.000
σ131.336-138.700=-7.364
min1638.000-1633.000=5.000
max1907.000-1916.000=-9.000
mean3.093-3.088=0.006
σ0.423-0.296=0.127
min2.763-2.872=-0.108
max3.826-3.599=0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.241-1.226=0.015
σ0.326-0.343=-0.017
min0.931-0.932=-0.001
max1.717-1.807=-0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.001
σ581.212-581.211=0.001
min157.178-157.178=-0.000
max1319.605-1319.602=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean0.540-0.557=-0.018
σ0.556-0.594=-0.038
min0.259-0.260=-0.001
max1.374-1.448=-0.075
policies=20
mean1572.088-1572.101=-0.013
σ0.342-0.349=-0.008
min1571.867-1571.863=0.004
max1572.598-1572.620=-0.022
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean2.627-2.617=0.010
σ0.022-0.020=0.002
min2.611-2.589=0.022
max2.658-2.632=0.026
policies=200
mean15728.995-15729.012=-0.017
σ0.189-0.053=0.136
min15728.834-15728.933=-0.099
max15729.260-15729.047=0.213
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1633.000=5.000
σ0.000
min1638.000-1633.000=5.000
max1638.000-1633.000=5.000
mean26.452-26.488=-0.036
σ0.011-0.111=-0.101
min26.440-26.373=0.067
max26.465-26.637=-0.172