Compare commits

Home / Compare 6d2bc7d4 .. cc498ae2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.057=-0.003
σ0.369-0.368=0.000
min53.911-53.917=-0.006
max55.103-55.105=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.137-0.142=-0.005
σ0.005-0.004=0.001
min0.131-0.139=-0.008
max0.148-0.149=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.005=0.000
min43.387-43.387=-0.001
max43.403-43.406=-0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.122-0.119=0.002
σ0.004-0.003=0.001
min0.117-0.114=0.003
max0.129-0.125=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.000=0.005
σ1.190-1.188=0.002
min1006.430-1006.440=-0.011
max1011.993-1011.982=0.011
mean1051.400-1047.250=4.150
σ307.928-314.968=-7.040
min576.000-589.000=-13.000
max1644.000-1650.000=-6.000
mean1.555-1.537=0.018
σ0.081-0.075=0.006
min1.454-1.469=-0.015
max1.764-1.774=-0.010

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.423-0.418=0.005
σ0.146-0.127=0.020
min0.344-0.349=-0.005
max0.684-0.643=0.041
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.002=0.000
min2.337
max2.342
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.923-0.879=0.043
σ0.195-0.095=0.100
min0.821-0.821=-0.000
max1.271-1.047=0.224
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.532-0.528=0.004
σ0.049-0.052=-0.003
min0.497-0.485=0.011
max0.615-0.613=0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.845-0.838=0.007
σ0.046-0.039=0.006
min0.803-0.811=-0.008
max0.917-0.907=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.034-0.035=-0.001
min964.810-964.810=-0.000
max964.894-964.896=-0.002
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.825-0.850=-0.025
σ0.032-0.022=0.010
min0.776-0.811=-0.035
max0.853-0.865=-0.012
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.007=0.000
min885.504-885.505=-0.001
max885.522-885.522=-0.000
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.701-0.727=-0.026
σ0.034-0.034=-0.000
min0.665-0.669=-0.005
max0.738-0.756=-0.019

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean4.232-3.718=0.514
σ0.082-0.362=-0.280
min4.075-3.310=0.765
max4.619-4.524=0.095
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean4.213-4.188=0.025
σ0.069-0.080=-0.012
min4.088-4.062=0.026
max4.429-4.489=-0.060
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.743-0.740=0.004
σ0.018-0.020=-0.002
min0.709-0.703=0.007
max0.861-0.859=0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.706-0.703=0.004
σ0.015-0.016=-0.001
min0.675-0.673=0.002
max0.760-0.775=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.811-297.142=-0.331
σ0.267-0.200=0.067
min296.574-297.003=-0.429
max297.538-297.684=-0.146
mean1941.000-1916.000=25.000
σ0.000
min1941.000-1916.000=25.000
max1941.000-1916.000=25.000
mean0.597-0.577=0.020
σ0.021-0.040=-0.019
min0.573-0.510=0.062
max0.646-0.644=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.830-286.817=0.013
σ0.039-0.037=0.002
min286.779-286.766=0.013
max286.871-286.854=0.017
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.394-0.397=-0.003
σ0.007-0.005=0.002
min0.384-0.392=-0.008
max0.401-0.403=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.221-1297.250=-0.029
σ0.112-0.069=0.043
min1297.093-1297.172=-0.079
max1297.351-1297.336=0.016
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean1.905-2.114=-0.208
σ0.094-0.070=0.024
min1.801-2.029=-0.227
max1.998-2.188=-0.189
iters=5
new-facts=6402
prior-facts=1
mean1541.320-1541.323=-0.003
σ6.824-6.841=-0.018
min1538.094-1538.098=-0.003
max1553.523-1553.557=-0.034
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean2.206-2.247=-0.041
σ0.183-0.150=0.033
min2.055-2.082=-0.027
max2.472-2.429=0.043
iters=5
new-facts=6402
prior-facts=6402
mean1859.121-1859.111=0.010
σ0.059-0.080=-0.020
min1859.064-1858.998=0.066
max1859.200-1859.193=0.006
mean1786.800-1776.200=10.600
σ149.046-133.866=15.180
min1644.000-1650.000=-6.000
max1941.000-1916.000=25.000
mean2.961-3.123=-0.162
σ0.173-0.196=-0.023
min2.856-2.899=-0.043
max3.259-3.418=-0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.195=0.013
σ0.282-0.267=0.014
min0.925-0.938=-0.013
max1.670-1.583=0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=0.000
σ581.372-581.372=-0.000
min158.132-158.132=0.000
max1320.878-1320.878=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean0.562-0.554=0.008
σ0.589-0.579=0.009
min0.260-0.261=-0.001
max1.445-1.423=0.021
policies=20
mean1581.610-1581.610=-0.000
σ0.355-0.360=-0.005
min1581.367-1581.368=-0.002
max1582.137-1582.146=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean2.630-2.635=-0.006
σ0.009-0.019=-0.010
min2.617-2.610=0.007
max2.639-2.657=-0.019
policies=200
mean15824.164-15824.241=-0.078
σ0.123-0.115=0.008
min15823.986-15824.135=-0.149
max15824.260-15824.402=-0.142
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1650.000=-6.000
σ0.000
min1644.000-1650.000=-6.000
max1644.000-1650.000=-6.000
mean26.457-26.613=-0.156
σ0.027-0.031=-0.004
min26.435-26.576=-0.141
max26.494-26.650=-0.156