Compare commits

Home / Compare 6a9dead8 .. 500d7c39

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.367-0.370=-0.003
min53.911-53.911=0.001
max55.099-55.106=-0.007
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.140-0.140=0.000
σ0.005-0.005=-0.000
min0.132-0.133=-0.000
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.000
σ0.005-0.005=-0.000
min43.387-43.387=0.000
max43.402-43.402=-0.000
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.122-0.123=-0.001
σ0.004-0.004=0.000
min0.119-0.120=-0.001
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.002=0.001
σ1.201-1.204=-0.003
min1006.433-1006.459=-0.027
max1012.040-1012.051=-0.011
mean1051.400-1053.050=-1.650
σ307.021-310.072=-3.051
min578.000-554.000=24.000
max1635.000-1646.000=-11.000
mean1.545-1.572=-0.027
σ0.058-0.089=-0.031
min1.491-1.485=0.006
max1.704-1.804=-0.100

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.415-0.424=-0.009
σ0.125-0.127=-0.002
min0.336-0.351=-0.015
max0.634-0.648=-0.015
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.879-0.887=-0.008
σ0.095-0.095=-0.000
min0.802-0.817=-0.015
max1.043-1.049=-0.006
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.536-0.544=-0.008
σ0.045-0.056=-0.011
min0.488-0.499=-0.011
max0.605-0.631=-0.026
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.848-0.858=-0.010
σ0.041-0.031=0.011
min0.819-0.834=-0.016
max0.919-0.910=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.838=0.000
σ0.034-0.034=0.000
min964.811-964.811=-0.001
max964.896-964.895=0.001
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.791-0.835=-0.044
σ0.036-0.014=0.022
min0.748-0.810=-0.062
max0.829-0.843=-0.013
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.008=-0.000
min885.505-885.504=0.001
max885.523-885.523=0.001
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.694-0.686=0.008
σ0.048-0.046=0.003
min0.643-0.627=0.016
max0.755-0.733=0.022

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean4.210-4.247=-0.038
σ0.098-0.102=-0.004
min4.076-4.067=0.009
max4.701-4.557=0.144
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean4.183-4.173=0.010
σ0.074-0.239=-0.165
min4.053-3.442=0.611
max4.417-4.551=-0.134
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.744-0.694=0.050
σ0.017-0.102=-0.085
min0.712-0.521=0.191
max0.854-0.856=-0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.619-0.437=0.182
σ0.099-0.126=-0.027
min0.493-0.279=0.214
max0.773-0.899=-0.126

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.955-297.030=-0.075
σ0.205-0.249=-0.044
min296.838-296.879=-0.041
max297.519-297.720=-0.201
mean2054.000-1904.000=150.000
σ0.000
min2054.000-1904.000=150.000
max2054.000-1904.000=150.000
mean0.545-0.576=-0.031
σ0.030-0.041=-0.011
min0.509-0.511=-0.002
max0.578-0.657=-0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.817-286.819=-0.002
σ0.036-0.038=-0.002
min286.770-286.764=0.006
max286.852-286.855=-0.003
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.392-0.397=-0.005
σ0.008-0.007=0.001
min0.386-0.388=-0.002
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.244-1297.280=-0.036
σ0.074-0.083=-0.009
min1297.162-1297.177=-0.015
max1297.301-1297.395=-0.094
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.041-2.214=-0.173
σ0.037-0.034=0.004
min1.978-2.169=-0.191
max2.070-2.251=-0.181
iters=5
new-facts=6402
prior-facts=1
mean1541.301-1541.347=-0.046
σ6.846-6.819=0.028
min1538.029-1538.151=-0.122
max1553.543-1553.542=0.001
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.167-2.252=-0.085
σ0.131-0.129=0.003
min2.089-2.151=-0.062
max2.397-2.410=-0.013
iters=5
new-facts=6402
prior-facts=6402
mean1859.121-1859.114=0.008
σ0.082-0.070=0.012
min1859.001-1859.026=-0.025
max1859.212-1859.199=0.013
mean1793.400-1774.200=19.200
σ181.230-125.587=55.643
min1635.000-1646.000=-11.000
max2054.000-1904.000=150.000
mean3.019-3.065=-0.047
σ0.050-0.207=-0.157
min2.969-2.849=0.120
max3.080-3.326=-0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.208=0.032
σ0.306-0.345=-0.038
min0.924-0.929=-0.004
max1.733-1.727=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=-0.001
σ581.373-581.372=0.000
min158.133-158.133=0.000
max1320.880-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.541-0.572=-0.031
σ0.564-0.602=-0.037
min0.243-0.269=-0.026
max1.387-1.474=-0.087
policies=20
mean1581.618-1581.618=0.000
σ0.360-0.361=-0.001
min1581.377-1581.375=0.002
max1582.153-1582.155=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.638-2.647=-0.008
σ0.026-0.009=0.018
min2.610-2.633=-0.023
max2.669-2.653=0.017
policies=200
mean15824.184-15824.262=-0.078
σ0.076-0.104=-0.027
min15824.114-15824.188=-0.074
max15824.290-15824.414=-0.124
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean26.647-26.754=-0.107
σ0.024-0.223=-0.199
min26.625-26.620=0.005
max26.669-27.087=-0.418