Compare commits

Home / Compare e4a0bc0d .. a8442277

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.001
σ0.370-0.370=-0.000
min53.912-53.909=0.003
max55.107-55.108=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.141=-0.002
σ0.004-0.007=-0.003
min0.135-0.135=0.000
max0.146-0.152=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.006=-0.001
min43.386-43.384=0.001
max43.404-43.406=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.120-0.121=-0.002
σ0.003-0.005=-0.002
min0.116-0.114=0.001
max0.124-0.131=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.001-1007.004=-0.003
σ1.212-1.209=0.003
min1006.442-1006.449=-0.007
max1012.086-1012.075=0.012
mean1054.300-1051.600=2.700
σ314.827-307.746=7.081
min584.000-577.000=7.000
max1618.000-1643.000=-25.000
mean1.546-1.545=0.001
σ0.059-0.086=-0.027
min1.474-1.398=0.076
max1.664-1.758=-0.094

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.884=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.423-0.423=0.000
σ0.151-0.149=0.002
min0.334-0.334=-0.001
max0.692-0.688=0.004
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.003=-0.001
min2.337
max2.342-2.344=-0.002
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.898-0.888=0.010
σ0.099-0.097=0.002
min0.845-0.820=0.025
max1.074-1.056=0.017
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.537-0.536=0.001
σ0.055-0.046=0.010
min0.495-0.495=0.000
max0.631-0.609=0.022
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.838-0.859=-0.021
σ0.032-0.042=-0.010
min0.813-0.821=-0.008
max0.893-0.929=-0.036

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.831=0.006
σ0.031-0.025=0.006
min964.811-964.802=0.010
max964.889-964.862=0.028
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.850-0.794=0.056
σ0.019-0.087=-0.069
min0.820-0.644=0.176
max0.871-0.854=0.017
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.005-0.005=-0.000
min885.504
max885.517-885.517=-0.001
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.711-0.680=0.030
σ0.021-0.048=-0.028
min0.679-0.606=0.073
max0.732-0.740=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean4.279-3.501=0.778
σ0.089-0.096=-0.008
min4.142-3.342=0.800
max4.567-3.907=0.659
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean4.193-3.491=0.701
σ0.071-0.079=-0.008
min3.942-3.364=0.579
max4.462-3.750=0.712
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.730-0.701=0.030
σ0.058-0.087=-0.029
min0.517-0.514=0.003
max0.865-0.840=0.025
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.688-0.504=0.184
σ0.023-0.012=0.011
min0.649-0.484=0.165
max0.809-0.562=0.247

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.054-297.018=0.036
σ0.212-0.181=0.031
min296.912-296.801=0.111
max297.640-297.481=0.159
mean1923.000-1951.000=-28.000
σ0.000
min1923.000-1951.000=-28.000
max1923.000-1951.000=-28.000
mean0.594-0.599=-0.006
σ0.051-0.013=0.037
min0.538-0.587=-0.049
max0.711-0.628=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.823=-0.004
σ0.037-0.040=-0.003
min286.767-286.767=-0.000
max286.859-286.866=-0.007
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.398-0.395=0.003
σ0.007-0.006=0.001
min0.390-0.388=0.003
max0.404-0.400=0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.259-1297.286=-0.026
σ0.102-0.086=0.016
min1297.110-1297.182=-0.072
max1297.381-1297.410=-0.028
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean2.211-2.240=-0.030
σ0.065-0.040=0.025
min2.149-2.188=-0.039
max2.293-2.295=-0.003
iters=5
new-facts=6402
prior-facts=1
mean1541.374-1541.338=0.036
σ6.802-6.817=-0.015
min1538.220-1538.122=0.099
max1553.541-1553.530=0.011
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean2.328-2.214=0.114
σ0.247-0.079=0.168
min2.158-2.125=0.033
max2.739-2.339=0.401
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.119=-0.008
σ0.066-0.069=-0.003
min1859.034-1859.033=0.001
max1859.186-1859.199=-0.012
mean1766.400-1791.200=-24.800
σ152.775-154.545=-1.770
min1618.000-1643.000=-25.000
max1923.000-1951.000=-28.000
mean3.034-2.938=0.096
σ0.223-0.103=0.120
min2.745-2.815=-0.070
max3.251-3.039=0.211

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.292-1.358=-0.066
σ0.341-0.350=-0.009
min0.929-0.930=-0.001
max1.836-1.877=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.000
min158.134-158.134=0.001
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean0.547-0.568=-0.021
σ0.567-0.608=-0.041
min0.261-0.260=0.001
max1.397-1.479=-0.082
policies=20
mean1581.631-1581.630=0.001
σ0.364-0.380=-0.016
min1581.384-1581.377=0.006
max1582.173-1582.196=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean2.647-2.659=-0.012
σ0.017-0.043=-0.026
min2.636-2.621=0.015
max2.673-2.721=-0.048
policies=200
mean15824.242-15824.164=0.078
σ0.135-0.100=0.035
min15824.124-15824.020=0.104
max15824.418-15824.249=0.169
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1643.000=-25.000
σ0.000
min1618.000-1643.000=-25.000
max1618.000-1643.000=-25.000
mean26.667-26.699=-0.033
σ0.151-0.068=0.083
min26.503-26.651=-0.148
max26.869-26.795=0.074