Compare commits

Home / Compare 537b226c .. 8a09c17e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.053-54.055=-0.001
σ0.371-0.369=0.003
min53.907-53.911=-0.003
max55.109-55.103=0.006
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.136-0.140=-0.004
σ0.004-0.006=-0.002
min0.132-0.132=0.001
max0.142-0.149=-0.007
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.007=-0.001
min43.384-43.383=0.001
max43.403-43.407=-0.004
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.122=-0.002
σ0.005-0.003=0.001
min0.115-0.118=-0.003
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.009-1007.007=0.002
σ1.182-1.189=-0.008
min1006.433-1006.432=0.001
max1011.954-1011.989=-0.035
mean1052.350-1048.500=3.850
σ307.919-306.947=0.972
min577.000-575.000=2.000
max1644.000-1632.000=12.000
mean1.536-1.543=-0.006
σ0.097-0.097=0.000
min1.452-1.465=-0.013
max1.804-1.826=-0.023

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.432-0.418=0.014
σ0.143-0.136=0.007
min0.352-0.328=0.025
max0.687-0.658=0.029
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.890-0.882=0.008
σ0.094-0.082=0.012
min0.827-0.837=-0.010
max1.053-1.028=0.025
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.546-0.538=0.008
σ0.055-0.046=0.009
min0.500-0.494=0.006
max0.634-0.614=0.020
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.854-0.853=0.001
σ0.037-0.033=0.004
min0.822-0.826=-0.005
max0.908-0.909=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.034-0.034=-0.001
min964.811-964.810=0.001
max964.892-964.896=-0.003
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.839-0.813=0.025
σ0.037-0.050=-0.013
min0.774-0.730=0.044
max0.864-0.860=0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.008=-0.001
min885.505
max885.523-885.524=-0.002
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.697-0.717=-0.021
σ0.043-0.032=0.011
min0.642-0.674=-0.032
max0.740-0.746=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.002
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean4.256-3.529=0.727
σ0.096-0.075=0.021
min4.101-3.409=0.693
max4.662-3.819=0.843
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean4.245-3.513=0.733
σ0.080-0.075=0.005
min4.127-3.374=0.753
max4.521-3.839=0.683
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.758-0.752=0.006
σ0.018-0.018=-0.001
min0.726-0.717=0.009
max0.877-0.856=0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.719-0.718=0.001
σ0.015-0.013=0.002
min0.685-0.694=-0.009
max0.801-0.775=0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.917-296.877=0.040
σ0.266-0.255=0.011
min296.710-296.694=0.016
max297.636-297.579=0.057
mean1913.000-1893.000=20.000
σ0.000
min1913.000-1893.000=20.000
max1913.000-1893.000=20.000
mean0.585-0.576=0.009
σ0.043-0.044=-0.000
min0.534-0.506=0.028
max0.684-0.672=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.829-286.827=0.002
σ0.033-0.038=-0.005
min286.793-286.780=0.013
max286.865-286.868=-0.003
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.409-0.394=0.016
σ0.011-0.004=0.007
min0.395-0.390=0.006
max0.425-0.400=0.025
iters=5
new-facts=1
prior-facts=6402
mean1297.229-1297.232=-0.003
σ0.079-0.043=0.036
min1297.131-1297.173=-0.042
max1297.307-1297.287=0.020
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean2.062-2.059=0.003
σ0.069-0.118=-0.048
min1.984-1.996=-0.012
max2.134-2.269=-0.134
iters=5
new-facts=6402
prior-facts=1
mean1541.402-1541.362=0.040
σ6.836-6.825=0.011
min1538.167-1538.140=0.027
max1553.628-1553.568=0.059
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean2.370-2.320=0.050
σ0.205-0.217=-0.012
min2.105-2.047=0.058
max2.651-2.501=0.150
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.117=-0.002
σ0.085-0.084=0.001
min1858.996-1858.991=0.005
max1859.198-1859.205=-0.007
mean1777.200-1774.400=2.800
σ131.532-124.380=7.152
min1644.000-1632.000=12.000
max1913.000-1893.000=20.000
mean3.086-2.971=0.115
σ0.200-0.196=0.004
min2.855-2.747=0.108
max3.312-3.249=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.241-1.228=0.013
σ0.337-0.382=-0.045
min0.930-0.934=-0.004
max1.701-1.836=-0.134

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=-0.000
min158.135-158.135=0.000
max1320.880-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean0.565-0.564=0.001
σ0.602-0.603=-0.000
min0.258-0.260=-0.002
max1.469-1.468=0.001
policies=20
mean1581.632-1581.633=-0.001
σ0.363-0.366=-0.003
min1581.390-1581.387=0.003
max1582.172-1582.177=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean2.647-2.653=-0.005
σ0.015-0.027=-0.012
min2.628-2.623=0.005
max2.666-2.689=-0.023
policies=200
mean15824.263-15824.160=0.103
σ0.086-0.114=-0.029
min15824.165-15824.065=0.100
max15824.373-15824.323=0.051
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1632.000=12.000
σ0.000
min1644.000-1632.000=12.000
max1644.000-1632.000=12.000
mean26.613-26.534=0.079
σ0.100-0.033=0.067
min26.499-26.486=0.013
max26.718-26.556=0.162