Compare commits

Home / Compare fb813f22 .. 05454a8f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.002
σ0.367-0.368=-0.001
min53.911-53.920=-0.009
max55.099-55.104=-0.005
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.140-0.140=-0.000
σ0.005-0.005=-0.000
min0.132-0.132=-0.000
max0.148-0.149=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.005-0.006=-0.001
min43.387-43.384=0.003
max43.402-43.405=-0.003
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.122-0.120=0.002
σ0.004-0.001=0.002
min0.119-0.118=0.000
max0.129-0.122=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.005=-0.002
σ1.201-1.190=0.011
min1006.433-1006.439=-0.007
max1012.040-1011.993=0.047
mean1051.400-1046.700=4.700
σ307.021-314.138=-7.117
min578.000-572.000=6.000
max1635.000-1640.000=-5.000
mean1.545-1.555=-0.010
σ0.058-0.078=-0.020
min1.491-1.470=0.021
max1.704-1.757=-0.053

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.415-0.408=0.006
σ0.125-0.126=-0.002
min0.336-0.330=0.007
max0.634-0.632=0.002
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.879-0.883=-0.003
σ0.095-0.093=0.002
min0.802-0.812=-0.010
max1.043-1.044=-0.001
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.536-0.539=-0.003
σ0.045-0.045=-0.001
min0.488-0.506=-0.018
max0.605-0.612=-0.007
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.848-0.854=-0.007
σ0.041-0.041=0.000
min0.819-0.820=-0.002
max0.919-0.926=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.837=0.001
σ0.034-0.037=-0.002
min964.811-964.807=0.004
max964.896-964.898=-0.002
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.791-0.791=0.000
σ0.036-0.044=-0.008
min0.748-0.732=0.015
max0.829-0.849=-0.020
name=cdr_enhanced_4k_loc.art
mean885.512-885.514=-0.002
σ0.007-0.001=0.007
min885.505-885.513=-0.008
max885.523-885.515=0.008
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.694-0.701=-0.007
σ0.048-0.046=0.002
min0.643-0.626=0.017
max0.755-0.736=0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean4.210-4.186=0.024
σ0.098-0.093=0.005
min4.076-4.011=0.065
max4.701-4.528=0.172
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean4.183-4.166=0.017
σ0.074-0.065=0.009
min4.053-4.044=0.009
max4.417-4.370=0.047
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.744-0.737=0.007
σ0.017-0.021=-0.004
min0.712-0.705=0.008
max0.854-0.842=0.012
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.619-0.700=-0.080
σ0.099-0.014=0.085
min0.493-0.664=-0.172
max0.773-0.746=0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.955-296.995=-0.040
σ0.205-0.238=-0.033
min296.838-296.822=0.016
max297.519-297.650=-0.131
mean2054.000-2055.000=-1.000
σ0.000
min2054.000-2055.000=-1.000
max2054.000-2055.000=-1.000
mean0.545-0.559=-0.014
σ0.030-0.030=-0.000
min0.509-0.517=-0.007
max0.578-0.588=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.817-286.820=-0.003
σ0.036-0.037=-0.001
min286.770-286.773=-0.003
max286.852-286.858=-0.006
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.392-0.396=-0.004
σ0.008-0.006=0.002
min0.386-0.390=-0.004
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.244-1297.213=0.031
σ0.074-0.073=0.001
min1297.162-1297.133=0.029
max1297.301-1297.301=0.000
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean2.041-2.051=-0.009
σ0.037-0.047=-0.010
min1.978-2.000=-0.022
max2.070-2.124=-0.054
iters=5
new-facts=6402
prior-facts=1
mean1541.301-1541.353=-0.052
σ6.846-6.814=0.032
min1538.029-1538.165=-0.135
max1553.543-1553.540=0.002
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean2.167-2.301=-0.134
σ0.131-0.240=-0.109
min2.089-2.140=-0.051
max2.397-2.699=-0.302
iters=5
new-facts=6402
prior-facts=6402
mean1859.121-1859.115=0.007
σ0.082-0.085=-0.003
min1859.001-1858.987=0.014
max1859.212-1859.199=0.013
mean1793.400-1795.400=-2.000
σ181.230-179.485=1.745
min1635.000-1640.000=-5.000
max2054.000-2055.000=-1.000
mean3.019-2.948=0.071
σ0.050-0.152=-0.102
min2.969-2.767=0.203
max3.080-3.119=-0.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.181=0.059
σ0.306-0.285=0.021
min0.924-0.935=-0.011
max1.733-1.584=0.149

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.820=0.001
σ581.373-581.372=0.001
min158.133-158.132=0.001
max1320.880-1320.878=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.541-0.553=-0.013
σ0.564-0.582=-0.018
min0.243-0.258=-0.015
max1.387-1.426=-0.039
policies=20
mean1581.618-1581.616=0.002
σ0.360-0.357=0.003
min1581.377-1581.374=0.002
max1582.153-1582.147=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean2.638-2.629=0.009
σ0.026-0.007=0.020
min2.610-2.622=-0.012
max2.669-2.636=0.034
policies=200
mean15824.184-15824.230=-0.046
σ0.076-0.105=-0.029
min15824.114-15824.151=-0.037
max15824.290-15824.381=-0.091
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean26.647-26.644=0.003
σ0.024-0.034=-0.010
min26.625-26.593=0.032
max26.669-26.665=0.004