Compare commits

Home / Compare 22e99345 .. 095ce0be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.002
σ0.370-0.369=0.002
min53.908-53.908=0.000
max55.109-55.103=0.007
mean419.000
σ0.000
min419.000
max419.000
mean0.140-0.138=0.002
σ0.004-0.004=0.001
min0.137-0.132=0.005
max0.149-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.001
σ0.007-0.006=0.001
min43.381-43.386=-0.004
max43.407-43.402=0.005
mean419.000
σ0.000
min419.000
max419.000
mean0.124-0.120=0.004
σ0.004-0.004=0.000
min0.119-0.115=0.004
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.979=-0.000
σ0.865-0.925=-0.060
min1006.479-1006.507=-0.028
max1010.557-1010.827=-0.270
mean1056.900-1055.650=1.250
σ321.885-306.148=15.737
min579.000-576.000=3.000
max1638.000-1457.000=181.000
mean1.534-1.568=-0.034
σ0.090-0.135=-0.046
min1.443-1.469=-0.026
max1.864-2.021=-0.156

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.414-0.441=-0.027
σ0.117-0.126=-0.009
min0.338-0.352=-0.013
max0.619-0.659=-0.040
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.872-0.886=-0.014
σ0.084-0.097=-0.013
min0.814-0.826=-0.011
max1.018-1.058=-0.040
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.530-0.532=-0.001
σ0.051-0.051=-0.000
min0.500-0.482=0.017
max0.619-0.616=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.842-0.843=-0.001
σ0.020-0.040=-0.020
min0.827-0.816=0.010
max0.874-0.911=-0.037

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.822=0.009
σ0.024-0.026=-0.001
min964.802
max964.861-964.864=-0.003
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.772-0.829=-0.057
σ0.049-0.032=0.018
min0.723-0.795=-0.073
max0.844-0.865=-0.021
name=cdr_enhanced_4k_loc.art
mean885.514-885.511=0.003
σ0.008-0.006=0.001
min885.504
max885.522-885.518=0.003
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.691-0.736=-0.045
σ0.044-0.008=0.036
min0.643-0.723=-0.080
max0.745-0.745=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.719=0.001
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean4.209-3.535=0.674
σ0.087-0.084=0.003
min4.080-3.395=0.685
max4.516-3.894=0.621
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.671-7.668=0.003
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean4.209-3.523=0.686
σ0.077-0.064=0.013
min4.045-3.386=0.659
max4.436-3.734=0.702
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.737-0.540=0.197
σ0.022-0.015=0.006
min0.708-0.520=0.188
max0.852-0.638=0.214
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.698-0.506=0.192
σ0.014-0.016=-0.002
min0.669-0.475=0.194
max0.768-0.569=0.198

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.560-295.628=-0.068
σ0.238-0.285=-0.048
min295.418-295.466=-0.049
max296.223-296.421=-0.198
mean1910.000-1905.000=5.000
σ0.000
min1910.000-1905.000=5.000
max1910.000-1905.000=5.000
mean0.567-0.583=-0.016
σ0.060-0.046=0.013
min0.496-0.500=-0.004
max0.696-0.645=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.398=0.012
σ0.038-0.030=0.007
min285.359-285.360=-0.001
max285.448-285.431=0.017
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.386-0.403=-0.017
σ0.009-0.005=0.004
min0.382-0.396=-0.014
max0.402-0.410=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.765=0.028
σ0.109-0.069=0.040
min1295.678-1295.676=0.002
max1295.923-1295.838=0.085
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean1.914-1.913=0.000
σ0.091-0.102=-0.011
min1.815-1.819=-0.004
max2.019-2.048=-0.029
iters=5
new-facts=6402
prior-facts=1
mean1539.933-1539.992=-0.059
σ6.863-6.860=0.003
min1536.577-1536.776=-0.200
max1552.203-1552.261=-0.058
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean2.363-2.503=-0.140
σ0.251-0.156=0.095
min2.065-2.248=-0.183
max2.588-2.645=-0.057
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.700=0.002
σ0.053-0.051=0.002
min1857.649-1857.654=-0.006
max1857.773-1857.774=-0.001
mean1777.400-1744.600=32.800
σ132.359-171.144=-38.785
min1638.000-1505.000=133.000
max1910.000-1905.000=5.000
mean3.112-3.058=0.054
σ0.253-0.264=-0.011
min2.855-2.869=-0.014
max3.434-3.524=-0.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.419-1.759=-0.341
σ0.203-0.129=0.074
min1.252-1.608=-0.357
max1.697-1.917=-0.221

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=-0.000
σ580.935-580.934=0.001
min155.270-155.272=-0.002
max1317.143-1317.142=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean0.532-0.542=-0.010
σ0.549-0.558=-0.008
min0.255-0.262=-0.007
max1.356-1.378=-0.022
policies=20
mean1552.994-1552.986=0.008
σ0.331-0.317=0.014
min1552.769-1552.769=0.000
max1553.486-1553.457=0.029
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean2.588-2.572=0.016
σ0.018-0.017=0.001
min2.567-2.557=0.010
max2.608-2.595=0.012
policies=200
mean15538.064-15538.060=0.005
σ0.074-0.060=0.014
min15538.002-15538.014=-0.012
max15538.166-15538.147=0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1457.000=181.000
σ0.000
min1638.000-1457.000=181.000
max1638.000-1457.000=181.000
mean26.197-26.140=0.057
σ0.088-0.018=0.071
min26.123-26.118=0.005
max26.317-26.161=0.156