Compare commits

Home / Compare 493a0856 .. 0cc94e07

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.367-0.367=-0.000
min53.909-53.911=-0.002
max55.100-55.099=0.000
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.141-0.140=0.001
σ0.004-0.005=-0.000
min0.138-0.132=0.005
max0.149-0.148=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.007-0.005=0.002
min43.385-43.387=-0.002
max43.410-43.402=0.008
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.120-0.119=0.001
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.003=0.002
σ1.201-1.201=-0.000
min1006.459-1006.433=0.027
max1012.038-1012.040=-0.002
mean1055.250-1051.400=3.850
σ307.841-307.021=0.820
min580.000-578.000=2.000
max1647.000-1635.000=12.000
mean1.551-1.545=0.005
σ0.086-0.058=0.028
min1.418-1.491=-0.073
max1.783-1.704=0.079

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.419-0.415=0.004
σ0.132-0.125=0.008
min0.347-0.336=0.010
max0.654-0.634=0.021
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.342-2.342=0.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.895-0.879=0.015
σ0.104-0.095=0.009
min0.827-0.802=0.025
max1.076-1.043=0.033
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.544-0.536=0.008
σ0.052-0.045=0.007
min0.505-0.488=0.017
max0.632-0.605=0.028
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.890-0.848=0.043
σ0.060-0.041=0.018
min0.834-0.819=0.015
max0.977-0.919=0.058

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.834-964.839=-0.004
σ0.030-0.034=-0.004
min964.810-964.811=-0.001
max964.886-964.896=-0.010
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.828-0.791=0.037
σ0.042-0.036=0.006
min0.760-0.748=0.012
max0.857-0.829=0.028
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.004-0.007=-0.003
min885.505
max885.516-885.523=-0.007
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.721-0.694=0.027
σ0.038-0.048=-0.011
min0.654-0.643=0.010
max0.740-0.755=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.721=0.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean4.249-4.210=0.039
σ0.096-0.098=-0.002
min4.111-4.076=0.035
max4.769-4.701=0.068
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean4.209-4.183=0.026
σ0.068-0.074=-0.006
min4.081-4.053=0.028
max4.443-4.417=0.026
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.744-0.744=0.000
σ0.017-0.017=-0.000
min0.716-0.712=0.004
max0.851-0.854=-0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.701-0.619=0.081
σ0.019-0.099=-0.080
min0.662-0.493=0.170
max0.795-0.773=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.003-296.955=0.048
σ0.258-0.205=0.053
min296.849-296.838=0.011
max297.709-297.519=0.190
mean1904.000-2054.000=-150.000
σ0.000
min1904.000-2054.000=-150.000
max1904.000-2054.000=-150.000
mean0.591-0.545=0.045
σ0.039-0.030=0.009
min0.539-0.509=0.029
max0.679-0.578=0.102

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.828-286.817=0.011
σ0.038-0.036=0.002
min286.781-286.770=0.011
max286.873-286.852=0.021
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.401-0.392=0.008
σ0.009-0.008=0.001
min0.391-0.386=0.005
max0.412-0.406=0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.273-1297.244=0.028
σ0.081-0.074=0.007
min1297.197-1297.162=0.035
max1297.388-1297.301=0.086
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean2.198-2.041=0.157
σ0.080-0.037=0.043
min2.067-1.978=0.089
max2.261-2.070=0.192
iters=5
new-facts=6402
prior-facts=1
mean1541.337-1541.301=0.037
σ6.833-6.846=-0.013
min1538.121-1538.029=0.092
max1553.558-1553.543=0.015
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean2.221-2.167=0.054
σ0.132-0.131=0.001
min2.112-2.089=0.023
max2.393-2.397=-0.004
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.121=-0.009
σ0.067-0.082=-0.015
min1859.033-1859.001=0.032
max1859.193-1859.212=-0.019
mean1781.000-1793.400=-12.400
σ125.178-181.230=-56.052
min1647.000-1635.000=12.000
max1904.000-2054.000=-150.000
mean3.097-3.019=0.078
σ0.321-0.050=0.271
min2.754-2.969=-0.215
max3.532-3.080=0.452

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.293-1.240=0.053
σ0.316-0.306=0.010
min0.938-0.924=0.014
max1.745-1.733=0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=0.000
σ581.371-581.373=-0.002
min158.133-158.133=-0.000
max1320.877-1320.880=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean0.552-0.541=0.011
σ0.579-0.564=0.014
min0.260-0.243=0.017
max1.420-1.387=0.033
policies=20
mean1581.616-1581.618=-0.002
σ0.338-0.360=-0.022
min1581.388-1581.377=0.011
max1582.119-1582.153=-0.035
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean2.634-2.638=-0.004
σ0.013-0.026=-0.014
min2.621-2.610=0.010
max2.649-2.669=-0.020
policies=200
mean15824.167-15824.184=-0.018
σ0.102-0.076=0.025
min15824.034-15824.114=-0.080
max15824.260-15824.290=-0.029
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1635.000=12.000
σ0.000
min1647.000-1635.000=12.000
max1647.000-1635.000=12.000
mean26.706-26.647=0.059
σ0.117-0.024=0.093
min26.616-26.625=-0.009
max26.868-26.669=0.198