Compare commits

Home / Compare 8d7f3ade .. ba5cf57a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.370-0.369=0.001
min53.911-53.913=-0.002
max55.109-55.105=0.004
mean420.000-422.000=-2.000
σ0.000
min420.000-422.000=-2.000
max420.000-422.000=-2.000
mean0.140-0.140=-0.000
σ0.004-0.006=-0.002
min0.132-0.131=0.001
max0.147-0.150=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.006-0.006=-0.000
min43.384-43.383=0.001
max43.402-43.403=-0.002
mean420.000-422.000=-2.000
σ0.000
min420.000-422.000=-2.000
max420.000-422.000=-2.000
mean0.122-0.118=0.003
σ0.004-0.003=0.001
min0.119-0.115=0.004
max0.129-0.122=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.004=-0.000
σ1.195-1.198=-0.003
min1006.442-1006.431=0.011
max1012.011-1012.026=-0.015
mean1055.950-1063.200=-7.250
σ305.307-314.381=-9.075
min582.000-594.000=-12.000
max1649.000-1627.000=22.000
mean1.551-1.537=0.014
σ0.084-0.054=0.030
min1.466-1.481=-0.015
max1.766-1.647=0.119

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.428-0.410=0.018
σ0.147-0.125=0.021
min0.341-0.326=0.015
max0.689-0.629=0.060
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.931-0.890=0.041
σ0.184-0.083=0.101
min0.824-0.826=-0.003
max1.256-1.035=0.221
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.536-0.534=0.001
σ0.050-0.051=-0.001
min0.493-0.493=0.001
max0.623-0.617=0.006
name=nested_use.art
mean2.361-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.857-0.839=0.018
σ0.039-0.043=-0.003
min0.827-0.813=0.015
max0.922-0.913=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.835=0.003
σ0.034-0.029=0.005
min964.809-964.811=-0.001
max964.894-964.886=0.008
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.845-0.825=0.021
σ0.011-0.033=-0.022
min0.827-0.787=0.040
max0.854-0.862=-0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.005=0.002
min885.505-885.504=0.001
max885.522-885.517=0.005
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.707-0.700=0.007
σ0.041-0.034=0.007
min0.638-0.664=-0.027
max0.741-0.737=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.722=-0.001
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean3.533-4.206=-0.673
σ0.111-0.075=0.036
min3.268-4.087=-0.819
max4.171-4.498=-0.327
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean3.505-4.203=-0.698
σ0.088-0.077=0.011
min3.368-4.042=-0.675
max3.878-4.493=-0.615
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.540-0.751=-0.211
σ0.014-0.023=-0.010
min0.520-0.632=-0.112
max0.625-0.852=-0.227
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.509-0.655=-0.146
σ0.011-0.087=-0.076
min0.490-0.493=-0.003
max0.552-0.779=-0.226

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.923-296.802=0.122
σ0.235-0.269=-0.034
min296.760-296.611=0.149
max297.575-297.550=0.025
mean1938.000-1907.000=31.000
σ0.000
min1938.000-1907.000=31.000
max1938.000-1907.000=31.000
mean0.591-0.586=0.006
σ0.017-0.039=-0.021
min0.556-0.522=0.033
max0.613-0.658=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.827=-0.002
σ0.041-0.037=0.005
min286.770-286.778=-0.009
max286.870-286.869=0.001
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.396-0.398=-0.002
σ0.008-0.004=0.004
min0.386-0.390=-0.004
max0.404-0.401=0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.233-1297.276=-0.043
σ0.058-0.107=-0.050
min1297.173-1297.143=0.030
max1297.298-1297.418=-0.119
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean2.070-2.224=-0.153
σ0.066-0.094=-0.028
min1.998-2.063=-0.064
max2.137-2.302=-0.165
iters=5
new-facts=6402
prior-facts=1
mean1541.351-1541.356=-0.005
σ6.814-6.814=0.000
min1538.165-1538.178=-0.013
max1553.537-1553.543=-0.005
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean2.319-2.273=0.046
σ0.265-0.187=0.078
min2.142-2.109=0.033
max2.761-2.578=0.183
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.114=0.002
σ0.085-0.066=0.019
min1858.999-1859.027=-0.028
max1859.210-1859.191=0.019
mean1788.000-1775.200=12.800
σ145.022-132.485=12.538
min1649.000-1627.000=22.000
max1938.000-1907.000=31.000
mean2.938-3.042=-0.104
σ0.101-0.185=-0.084
min2.796-2.873=-0.076
max3.058-3.293=-0.235

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.322=-0.131
σ0.293-0.288=0.006
min0.934-1.078=-0.145
max1.648-1.778=-0.130

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=0.000
σ581.372-581.372=-0.001
min158.132-158.131=0.002
max1320.878-1320.879=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean0.549-0.543=0.007
σ0.605-0.557=0.048
min0.225-0.260=-0.035
max1.456-1.378=0.078
policies=20
mean1581.611-1581.628=-0.017
σ0.355-0.365=-0.009
min1581.370-1581.380=-0.009
max1582.140-1582.170=-0.031
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean2.632-2.637=-0.006
σ0.013-0.013=-0.001
min2.623-2.624=-0.001
max2.650-2.654=-0.004
policies=200
mean15824.248-15824.180=0.068
σ0.119-0.093=0.026
min15824.132-15824.075=0.057
max15824.401-15824.294=0.107
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1627.000=22.000
σ0.000
min1649.000-1627.000=22.000
max1649.000-1627.000=22.000
mean26.537-26.562=-0.025
σ0.113-0.051=0.061
min26.372-26.491=-0.118
max26.627-26.612=0.015