Compare commits

Home / Compare a021bbc9 .. 3b4e1ba5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.370-0.367=0.004
min53.907-53.914=-0.007
max55.108-55.097=0.011
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.138-0.139=-0.000
σ0.005-0.007=-0.001
min0.131-0.131=0.000
max0.148-0.151=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.007-0.006=0.001
min43.386-43.386=-0.000
max43.409-43.407=0.002
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.120-0.122=-0.002
σ0.001-0.004=-0.003
min0.119-0.115=0.004
max0.122-0.129=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1007.006=0.001
σ1.192-1.173=0.019
min1006.431-1006.433=-0.002
max1012.001-1011.912=0.089
mean1051.000-1054.250=-3.250
σ308.957-319.876=-10.919
min576.000-589.000=-13.000
max1648.000-1621.000=27.000
mean1.525-1.533=-0.008
σ0.067-0.062=0.005
min1.447-1.465=-0.017
max1.697-1.719=-0.022

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.423-0.428=-0.005
σ0.146-0.143=0.002
min0.335-0.334=0.001
max0.682-0.676=0.006
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.885-0.867=0.018
σ0.096-0.097=-0.000
min0.820-0.794=0.027
max1.053-1.035=0.017
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.550-0.530=0.020
σ0.048-0.052=-0.004
min0.515-0.483=0.032
max0.629-0.615=0.014
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.864-0.843=0.021
σ0.040-0.045=-0.004
min0.817-0.801=0.016
max0.925-0.914=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.033-0.035=-0.002
min964.809-964.810=-0.000
max964.893-964.897=-0.004
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.856-0.837=0.019
σ0.007-0.028=-0.021
min0.847-0.787=0.061
max0.866-0.851=0.015
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.008-0.007=0.001
min885.504
max885.523-885.521=0.002
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.674-0.699=-0.025
σ0.071-0.042=0.029
min0.560-0.651=-0.091
max0.736-0.744=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.000
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean4.256-4.228=0.027
σ0.084-0.086=-0.002
min4.145-4.099=0.046
max4.539-4.572=-0.034
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean4.235-4.209=0.026
σ0.067-0.066=0.002
min4.099-4.095=0.004
max4.436-4.433=0.003
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.754-0.754=-0.000
σ0.020-0.018=0.002
min0.725-0.720=0.005
max0.859-0.860=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.703-0.718=-0.015
σ0.043-0.014=0.029
min0.504-0.683=-0.179
max0.834-0.766=0.068

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.991-296.915=0.075
σ0.246-0.264=-0.018
min296.807-296.733=0.074
max297.669-297.644=0.025
mean1956.000-1901.000=55.000
σ0.000
min1956.000-1901.000=55.000
max1956.000-1901.000=55.000
mean0.562-0.580=-0.019
σ0.055-0.041=0.014
min0.506-0.510=-0.004
max0.691-0.633=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.812-286.820=-0.008
σ0.043-0.036=0.007
min286.764-286.769=-0.005
max286.858-286.858=-0.001
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.395-0.396=-0.001
σ0.008-0.006=0.002
min0.387-0.390=-0.003
max0.406-0.403=0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.251-1297.228=0.023
σ0.074-0.064=0.010
min1297.170-1297.157=0.013
max1297.320-1297.303=0.017
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean2.090-2.068=0.022
σ0.089-0.051=0.038
min1.995-2.017=-0.021
max2.199-2.146=0.054
iters=5
new-facts=6402
prior-facts=1
mean1541.307-1541.335=-0.028
σ6.837-6.825=0.012
min1538.070-1538.145=-0.075
max1553.533-1553.541=-0.008
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean2.179-2.269=-0.090
σ0.089-0.248=-0.159
min2.100-2.064=0.036
max2.309-2.669=-0.359
iters=5
new-facts=6402
prior-facts=6402
mean1859.102-1859.115=-0.013
σ0.106-0.082=0.024
min1858.936-1858.997=-0.060
max1859.194-1859.206=-0.013
mean1795.200-1766.600=28.600
σ154.749-130.650=24.099
min1648.000-1621.000=27.000
max1956.000-1901.000=55.000
mean3.120-3.126=-0.006
σ0.367-0.321=0.046
min2.803-2.794=0.008
max3.717-3.594=0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.215=-0.006
σ0.335-0.349=-0.014
min0.929-0.933=-0.004
max1.770-1.785=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=0.000
σ581.372-581.371=0.001
min158.132-158.133=-0.001
max1320.878-1320.876=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean0.555-0.568=-0.012
σ0.580-0.600=-0.020
min0.262-0.263=-0.002
max1.425-1.467=-0.042
policies=20
mean1581.618-1581.628=-0.011
σ0.372-0.370=0.002
min1581.371-1581.371=-0.000
max1582.172-1582.177=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean2.659-2.652=0.007
σ0.034-0.016=0.018
min2.639-2.632=0.008
max2.710-2.665=0.046
policies=200
mean15824.239-15824.244=-0.005
σ0.142-0.096=0.046
min15824.127-15824.172=-0.045
max15824.429-15824.386=0.043
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1621.000=27.000
σ0.000
min1648.000-1621.000=27.000
max1648.000-1621.000=27.000
mean26.643-26.615=0.027
σ0.145-0.072=0.074
min26.513-26.540=-0.027
max26.844-26.685=0.159