Compare commits

Home / Compare 1372447c .. f658b046

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.370-0.367=0.003
min53.909-53.911=-0.003
max55.108-55.099=0.008
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.140=-0.000
σ0.005-0.005=0.000
min0.132-0.132=-0.001
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.005=0.002
min43.384-43.387=-0.003
max43.407-43.402=0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.122=-0.001
σ0.004-0.004=0.000
min0.115-0.119=-0.003
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.003=0.002
σ1.200-1.201=-0.001
min1006.443-1006.433=0.010
max1012.039-1012.040=-0.001
mean1050.200-1051.400=-1.200
σ309.011-307.021=1.990
min574.000-578.000=-4.000
max1647.000-1635.000=12.000
mean1.557-1.545=0.012
σ0.080-0.058=0.022
min1.481-1.491=-0.010
max1.777-1.704=0.073

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.419-0.415=0.004
σ0.137-0.125=0.013
min0.332-0.336=-0.004
max0.661-0.634=0.028
name=error_case.art
mean2.339-2.339=0.001
σ0.002-0.003=-0.000
min2.337
max2.342
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.865-0.879=-0.014
σ0.099-0.095=0.004
min0.802-0.802=0.000
max1.039-1.043=-0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.522-0.536=-0.014
σ0.050-0.045=0.005
min0.486-0.488=-0.002
max0.607-0.605=0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.838-0.848=-0.010
σ0.040-0.041=-0.002
min0.795-0.819=-0.024
max0.901-0.919=-0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.001
σ0.035-0.034=0.000
min964.811
max964.897-964.896=0.001
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.842-0.791=0.050
σ0.031-0.036=-0.005
min0.788-0.748=0.041
max0.865-0.829=0.036
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.001
σ0.007-0.007=0.000
min885.504-885.505=-0.001
max885.523-885.523=-0.001
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.726-0.694=0.032
σ0.030-0.048=-0.019
min0.675-0.643=0.032
max0.753-0.755=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean4.208-4.210=-0.002
σ0.090-0.098=-0.008
min4.046-4.076=-0.029
max4.575-4.701=-0.125
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean4.215-4.183=0.032
σ0.092-0.074=0.018
min4.030-4.053=-0.023
max4.599-4.417=0.182
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.739-0.744=-0.005
σ0.018-0.017=0.000
min0.700-0.712=-0.012
max0.848-0.854=-0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.694-0.619=0.074
σ0.016-0.099=-0.082
min0.665-0.493=0.172
max0.785-0.773=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.833-296.955=-0.122
σ0.221-0.205=0.016
min296.701-296.838=-0.137
max297.428-297.519=-0.091
mean1902.000-2054.000=-152.000
σ0.000
min1902.000-2054.000=-152.000
max1902.000-2054.000=-152.000
mean0.587-0.545=0.042
σ0.054-0.030=0.024
min0.509-0.509=-0.000
max0.702-0.578=0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.817=0.003
σ0.037-0.036=0.001
min286.770-286.770=-0.000
max286.857-286.852=0.005
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.393-0.392=0.001
σ0.006-0.008=-0.002
min0.386-0.386=0.000
max0.400-0.406=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1297.271-1297.244=0.027
σ0.091-0.074=0.016
min1297.158-1297.162=-0.004
max1297.397-1297.301=0.096
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean2.269-2.041=0.227
σ0.159-0.037=0.122
min2.139-1.978=0.161
max2.544-2.070=0.474
iters=5
new-facts=6402
prior-facts=1
mean1541.344-1541.301=0.043
σ6.841-6.846=-0.005
min1538.091-1538.029=0.062
max1553.578-1553.543=0.035
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean2.242-2.167=0.076
σ0.170-0.131=0.039
min2.130-2.089=0.041
max2.544-2.397=0.147
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.121=-0.003
σ0.066-0.082=-0.016
min1859.030-1859.001=0.030
max1859.196-1859.212=-0.016
mean1777.400-1793.400=-16.000
σ125.801-181.230=-55.429
min1647.000-1635.000=12.000
max1902.000-2054.000=-152.000
mean3.123-3.019=0.105
σ0.285-0.050=0.235
min2.833-2.969=-0.136
max3.550-3.080=0.471

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.240=-0.046
σ0.318-0.306=0.012
min0.930-0.924=0.006
max1.612-1.733=-0.121

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.373=-0.001
min158.134-158.133=0.001
max1320.879-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.562-0.541=0.022
σ0.598-0.564=0.033
min0.261-0.243=0.018
max1.459-1.387=0.072
policies=20
mean1581.629-1581.618=0.011
σ0.360-0.360=-0.000
min1581.386-1581.377=0.009
max1582.163-1582.153=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean2.638-2.638=-0.000
σ0.014-0.026=-0.012
min2.630-2.610=0.020
max2.659-2.669=-0.010
policies=200
mean15824.126-15824.184=-0.058
σ0.166-0.076=0.090
min15824.024-15824.114=-0.090
max15824.373-15824.290=0.083
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean26.630-26.647=-0.018
σ0.038-0.024=0.014
min26.603-26.625=-0.022
max26.686-26.669=0.017