Compare commits

Home / Compare 24182d08 .. 11ef860f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.370-0.369=0.000
min53.906-53.911=-0.005
max55.107-55.106=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.141-0.141=-0.000
σ0.005-0.004=0.001
min0.133-0.136=-0.003
max0.150-0.148=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.007-0.006=0.001
min43.385-43.386=-0.001
max43.403-43.404=-0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.122-0.123=-0.001
σ0.004-0.004=-0.000
min0.120-0.117=0.003
max0.133-0.128=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.000-1007.006=-0.006
σ1.218-1.188=0.029
min1006.435-1006.434=0.001
max1012.114-1011.986=0.129
mean1056.100-1052.400=3.700
σ314.045-308.002=6.042
min586.000-578.000=8.000
max1616.000-1645.000=-29.000
mean1.540-1.562=-0.022
σ0.053-0.081=-0.028
min1.469-1.409=0.061
max1.646-1.803=-0.157

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.423-0.415=0.008
σ0.148-0.141=0.008
min0.335-0.332=0.003
max0.686-0.666=0.020
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.896-0.880=0.016
σ0.104-0.097=0.008
min0.828-0.820=0.009
max1.078-1.051=0.028
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.543-0.528=0.015
σ0.052-0.050=0.003
min0.496-0.492=0.004
max0.632-0.614=0.018
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.847-0.844=0.002
σ0.043-0.043=-0.000
min0.820-0.816=0.004
max0.922-0.919=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.838=0.002
σ0.034-0.034=0.001
min964.812-964.810=0.002
max964.896-964.893=0.004
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.810-0.842=-0.033
σ0.028-0.015=0.013
min0.775-0.824=-0.049
max0.849-0.859=-0.010
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.008-0.004=0.004
min885.504-885.505=-0.001
max885.522-885.515=0.008
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.705-0.735=-0.030
σ0.066-0.016=0.050
min0.592-0.712=-0.120
max0.755-0.756=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean4.078-4.274=-0.196
σ0.310-0.125=0.185
min3.409-4.131=-0.722
max4.785-5.131=-0.346
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668-7.668=0.000
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean3.514-4.191=-0.677
σ0.084-0.070=0.014
min3.386-4.067=-0.681
max3.786-4.467=-0.681
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.537-0.734=-0.197
σ0.014-0.019=-0.005
min0.509-0.695=-0.185
max0.628-0.848=-0.220
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.505-0.694=-0.190
σ0.019-0.017=0.002
min0.361-0.659=-0.298
max0.562-0.770=-0.207

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.992-296.806=0.185
σ0.249-0.271=-0.021
min296.877-296.583=0.293
max297.695-297.519=0.176
mean1946.000-1923.000=23.000
σ0.000
min1946.000-1923.000=23.000
max1946.000-1923.000=23.000
mean0.596-0.605=-0.009
σ0.022-0.037=-0.014
min0.555-0.565=-0.010
max0.637-0.698=-0.060

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.827-286.827=-0.000
σ0.040-0.038=0.002
min286.774-286.777=-0.003
max286.872-286.864=0.008
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.397-0.394=0.003
σ0.005-0.008=-0.002
min0.389-0.385=0.004
max0.402-0.401=0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.260-1297.268=-0.008
σ0.102-0.099=0.003
min1297.105-1297.134=-0.029
max1297.373-1297.401=-0.027
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean2.190-2.233=-0.043
σ0.112-0.047=0.065
min2.051-2.170=-0.119
max2.361-2.280=0.080
iters=5
new-facts=6402
prior-facts=1
mean1541.378-1541.371=0.007
σ6.799-6.808=-0.009
min1538.229-1538.192=0.037
max1553.539-1553.547=-0.008
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean2.332-2.331=0.001
σ0.246-0.211=0.035
min2.171-2.166=0.005
max2.750-2.647=0.103
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.115=0.000
σ0.068-0.067=0.001
min1859.033-1859.029=0.004
max1859.191-1859.192=-0.002
mean1780.600-1777.400=3.200
σ162.889-139.781=23.108
min1616.000-1645.000=-29.000
max1946.000-1923.000=23.000
mean2.939-3.051=-0.113
σ0.203-0.155=0.048
min2.732-2.852=-0.120
max3.245-3.214=0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.244-1.250=-0.006
σ0.302-0.333=-0.031
min0.935-0.928=0.007
max1.730-1.796=-0.066

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.001
σ581.372-581.372=0.000
min158.131-158.135=-0.003
max1320.880-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean0.567-0.564=0.002
σ0.597-0.601=-0.004
min0.262-0.261=0.001
max1.462-1.466=-0.004
policies=20
mean1581.631-1581.631=0.001
σ0.363-0.367=-0.005
min1581.387-1581.384=0.003
max1582.170-1582.177=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean2.646-2.643=0.003
σ0.019-0.009=0.010
min2.623-2.630=-0.008
max2.669-2.652=0.017
policies=200
mean15824.155-15824.131=0.024
σ0.150-0.173=-0.023
min15824.027-15824.012=0.014
max15824.371-15824.386=-0.015
mean9200.000
σ0.000
min9200.000
max9200.000
mean1616.000-1645.000=-29.000
σ0.000
min1616.000-1645.000=-29.000
max1616.000-1645.000=-29.000
mean26.643-26.645=-0.002
σ0.147-0.022=0.125
min26.424-26.624=-0.200
max26.742-26.669=0.073