Compare commits

Home / Compare a8442277 .. cf1ead06

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.370-0.370=-0.000
min53.909-53.912=-0.003
max55.105-55.107=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.139-0.139=-0.000
σ0.005-0.004=0.002
min0.132-0.135=-0.003
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.006-0.006=-0.000
min43.383-43.386=-0.002
max43.402-43.404=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.120=0.001
σ0.005-0.003=0.002
min0.114-0.116=-0.001
max0.129-0.124=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.001=0.005
σ1.197-1.212=-0.014
min1006.453-1006.442=0.011
max1012.024-1012.086=-0.063
mean1047.700-1054.300=-6.600
σ304.649-314.827=-10.179
min575.000-584.000=-9.000
max1637.000-1618.000=19.000
mean1.574-1.546=0.028
σ0.097-0.059=0.038
min1.491-1.474=0.017
max1.823-1.664=0.159

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.422-0.423=-0.002
σ0.129-0.151=-0.022
min0.336-0.334=0.002
max0.648-0.692=-0.044
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.873-0.898=-0.025
σ0.095-0.099=-0.004
min0.814-0.845=-0.031
max1.040-1.074=-0.033
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.539-0.537=0.002
σ0.043-0.055=-0.012
min0.500-0.495=0.005
max0.607-0.631=-0.024
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.844-0.838=0.006
σ0.035-0.032=0.003
min0.807-0.813=-0.006
max0.902-0.893=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.837=0.002
σ0.035-0.031=0.003
min964.811-964.811=-0.001
max964.897-964.889=0.007
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.826-0.850=-0.024
σ0.032-0.019=0.013
min0.790-0.820=-0.030
max0.861-0.871=-0.010
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.008-0.005=0.003
min885.504
max885.524-885.517=0.007
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.720-0.711=0.009
σ0.017-0.021=-0.004
min0.702-0.679=0.023
max0.739-0.732=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean4.196-4.279=-0.083
σ0.067-0.089=-0.022
min4.068-4.142=-0.074
max4.420-4.567=-0.147
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean4.175-4.193=-0.018
σ0.079-0.071=0.008
min4.042-3.942=0.099
max4.560-4.462=0.098
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.740-0.730=0.010
σ0.032-0.058=-0.026
min0.523-0.517=0.006
max0.841-0.865=-0.024
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.699-0.688=0.011
σ0.014-0.023=-0.009
min0.668-0.649=0.018
max0.768-0.809=-0.041

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.004-297.054=-0.050
σ0.229-0.212=0.017
min296.816-296.912=-0.096
max297.620-297.640=-0.020
mean1892.000-1923.000=-31.000
σ0.000
min1892.000-1923.000=-31.000
max1892.000-1923.000=-31.000
mean0.567-0.594=-0.027
σ0.031-0.051=-0.020
min0.527-0.538=-0.011
max0.634-0.711=-0.077

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.828-286.819=0.009
σ0.038-0.037=0.001
min286.776-286.767=0.009
max286.869-286.859=0.010
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.396-0.398=-0.002
σ0.007-0.007=0.000
min0.388-0.390=-0.002
max0.403-0.404=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.269-1297.259=0.010
σ0.093-0.102=-0.009
min1297.140-1297.110=0.030
max1297.387-1297.381=0.006
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean2.202-2.211=-0.008
σ0.021-0.065=-0.044
min2.173-2.149=0.023
max2.223-2.293=-0.069
iters=5
new-facts=6402
prior-facts=1
mean1541.370-1541.374=-0.004
σ6.801-6.802=-0.001
min1538.211-1538.220=-0.009
max1553.535-1553.541=-0.006
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean2.302-2.328=-0.026
σ0.201-0.247=-0.046
min2.171-2.158=0.013
max2.635-2.739=-0.104
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.111=0.000
σ0.065-0.066=-0.000
min1859.024-1859.034=-0.010
max1859.189-1859.186=0.002
mean1773.800-1766.400=7.400
σ122.279-152.775=-30.496
min1637.000-1618.000=19.000
max1892.000-1923.000=-31.000
mean3.108-3.034=0.073
σ0.250-0.223=0.027
min2.869-2.745=0.124
max3.453-3.251=0.202

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.292=-0.079
σ0.373-0.341=0.032
min0.945-0.929=0.016
max1.841-1.836=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.822=-0.003
σ581.372-581.372=0.000
min158.132-158.134=-0.002
max1320.878-1320.880=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean0.553-0.547=0.006
σ0.570-0.567=0.004
min0.259-0.261=-0.002
max1.408-1.397=0.011
policies=20
mean1581.606-1581.631=-0.025
σ0.361-0.364=-0.003
min1581.360-1581.384=-0.024
max1582.143-1582.173=-0.030
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean2.641-2.647=-0.006
σ0.026-0.017=0.009
min2.606-2.636=-0.031
max2.668-2.673=-0.005
policies=200
mean15824.085-15824.242=-0.157
σ0.105-0.135=-0.030
min15824.010-15824.124=-0.114
max15824.236-15824.418=-0.182
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1618.000=19.000
σ0.000
min1637.000-1618.000=19.000
max1637.000-1618.000=19.000
mean26.743-26.667=0.077
σ0.125-0.151=-0.026
min26.620-26.503=0.118
max26.916-26.869=0.047