Compare commits

Home / Compare c71b7ac7 .. 547a1bf2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.001
σ0.369-0.369=0.001
min53.911-53.920=-0.009
max55.105-55.105=0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.138-0.139=-0.000
σ0.004-0.004=-0.000
min0.135-0.132=0.003
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.001
σ0.005-0.008=-0.003
min43.386-43.382=0.004
max43.402-43.407=-0.005
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.120-0.123=-0.003
σ0.004-0.004=0.001
min0.113-0.118=-0.005
max0.127-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.003=-0.001
σ1.196-1.196=0.001
min1006.447-1006.442=0.005
max1012.020-1012.015=0.005
mean1051.000-1053.350=-2.350
σ307.854-308.036=-0.182
min578.000
max1640.000-1645.000=-5.000
mean1.554-1.559=-0.005
σ0.086-0.066=0.020
min1.402-1.489=-0.086
max1.775-1.751=0.024

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.420-0.423=-0.003
σ0.141-0.137=0.004
min0.323-0.349=-0.025
max0.668-0.666=0.001
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.888-0.881=0.007
σ0.097-0.094=0.002
min0.826-0.821=0.005
max1.057-1.045=0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.540-0.543=-0.002
σ0.042-0.048=-0.006
min0.515-0.508=0.007
max0.615-0.625=-0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.863-0.849=0.014
σ0.038-0.052=-0.014
min0.838-0.818=0.020
max0.929-0.939=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.838=-0.000
σ0.032-0.033=-0.000
min964.811-964.816=-0.005
max964.894-964.893=0.000
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.819-0.856=-0.037
σ0.087-0.012=0.075
min0.664-0.845=-0.181
max0.868-0.875=-0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.007-0.006=0.001
min885.504-885.505=-0.001
max885.522-885.520=0.001
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.712-0.733=-0.022
σ0.041-0.023=0.017
min0.664-0.692=-0.028
max0.747-0.751=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean4.263-4.225=0.038
σ0.092-0.086=0.007
min4.118-4.093=0.025
max4.572-4.483=0.089
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean4.246-4.222=0.024
σ0.070-0.086=-0.016
min4.136-4.075=0.061
max4.492-4.578=-0.086
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.751-0.743=0.008
σ0.022-0.026=-0.004
min0.719-0.567=0.152
max0.880-0.844=0.036
name=record_render_syntax_err.art
mean2.166-2.166=-0.000
σ0.002-0.002=0.000
min2.165
max2.169
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.706-0.700=0.005
σ0.019-0.025=-0.006
min0.680-0.545=0.135
max0.847-0.760=0.086

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.027-296.995=0.032
σ0.180-0.193=-0.013
min296.838-296.836=0.002
max297.468-297.516=-0.047
mean2036.000-2066.000=-30.000
σ0.000
min2036.000-2066.000=-30.000
max2036.000-2066.000=-30.000
mean0.544-0.542=0.002
σ0.035-0.034=0.001
min0.498-0.502=-0.004
max0.595-0.577=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-286.817=0.007
σ0.038-0.039=-0.001
min286.774-286.769=0.006
max286.864-286.856=0.007
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.400-0.400=-0.000
σ0.008-0.008=-0.000
min0.390-0.390=-0.000
max0.408-0.408=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.285-1297.259=0.026
σ0.068-0.113=-0.045
min1297.214-1297.090=0.124
max1297.383-1297.392=-0.009
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean2.190-2.215=-0.025
σ0.076-0.104=-0.028
min2.071-2.125=-0.053
max2.263-2.332=-0.070
iters=5
new-facts=6402
prior-facts=1
mean1541.331-1541.375=-0.044
σ6.836-6.808=0.028
min1538.093-1538.227=-0.134
max1553.555-1553.552=0.003
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean2.193-2.317=-0.124
σ0.113-0.261=-0.147
min2.109-2.117=-0.008
max2.389-2.753=-0.364
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.118=-0.001
σ0.063-0.069=-0.006
min1859.027-1859.034=-0.008
max1859.185-1859.196=-0.011
mean1781.000-1800.800=-19.800
σ171.604-181.959=-10.355
min1640.000-1645.000=-5.000
max2036.000-2066.000=-30.000
mean2.928-2.996=-0.069
σ0.125-0.105=0.020
min2.827-2.842=-0.015
max3.143-3.109=0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.262-1.247=0.015
σ0.350-0.347=0.003
min0.937-0.940=-0.004
max1.847-1.801=0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.818=0.003
σ581.373-581.373=-0.000
min158.131-158.130=0.001
max1320.880-1320.877=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean0.556-0.551=0.005
σ0.575-0.555=0.021
min0.262-0.265=-0.003
max1.419-1.383=0.036
policies=20
mean1581.629-1581.605=0.024
σ0.365-0.373=-0.008
min1581.387-1581.353=0.034
max1582.172-1582.159=0.013
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean2.647-2.649=-0.003
σ0.010-0.013=-0.003
min2.636-2.633=0.002
max2.655-2.664=-0.009
policies=200
mean15824.239-15824.175=0.064
σ0.139-0.168=-0.029
min15824.094-15824.021=0.073
max15824.403-15824.405=-0.002
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1645.000=-5.000
σ0.000
min1640.000-1645.000=-5.000
max1640.000-1645.000=-5.000
mean26.651-26.742=-0.091
σ0.117-0.084=0.033
min26.545-26.649=-0.104
max26.808-26.840=-0.032