Compare commits

Home / Compare 2bea489b .. bc5a2de9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.000
σ0.370-0.368=0.002
min53.910-53.913=-0.003
max55.107-55.102=0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.142=-0.002
σ0.004-0.004=-0.000
min0.134-0.139=-0.005
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.006=0.001
min43.383-43.385=-0.002
max43.404-43.406=-0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.122=-0.001
σ0.004-0.004=-0.000
min0.115-0.117=-0.002
max0.126-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.004=-0.001
σ1.190-1.199=-0.009
min1006.431-1006.444=-0.013
max1011.992-1012.031=-0.039
mean1046.950-1050.100=-3.150
σ304.813-307.981=-3.169
min577.000-575.000=2.000
max1661.000-1642.000=19.000
mean1.556-1.538=0.018
σ0.084-0.078=0.006
min1.479-1.473=0.006
max1.799-1.756=0.043

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.413-0.422=-0.009
σ0.137-0.139=-0.002
min0.339-0.338=0.001
max0.656-0.668=-0.012
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.888-0.892=-0.004
σ0.097-0.092=0.005
min0.828-0.831=-0.004
max1.059-1.053=0.005
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.568-0.539=0.029
σ0.056-0.047=0.008
min0.509-0.500=0.009
max0.633-0.617=0.016
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.846-0.862=-0.016
σ0.047-0.034=0.013
min0.811-0.838=-0.027
max0.930-0.922=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.840=-0.002
σ0.027-0.035=-0.008
min964.815-964.810=0.005
max964.883-964.899=-0.016
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.792-0.842=-0.050
σ0.063-0.023=0.040
min0.729-0.802=-0.073
max0.858-0.855=0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.008-0.007=0.001
min885.504
max885.523-885.521=0.002
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.710-0.703=0.007
σ0.053-0.031=0.021
min0.620-0.671=-0.051
max0.751-0.738=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean4.212-4.238=-0.026
σ0.095-0.167=-0.072
min4.054-4.054=0.000
max4.649-5.538=-0.889
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean4.178-4.202=-0.024
σ0.076-0.094=-0.018
min4.043-4.022=0.021
max4.449-4.666=-0.217
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.732-0.747=-0.014
σ0.017-0.020=-0.003
min0.704-0.710=-0.006
max0.830-0.850=-0.020
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.695-0.704=-0.009
σ0.015-0.015=0.000
min0.665-0.672=-0.007
max0.771-0.770=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.053-296.753=0.300
σ0.227-0.238=-0.010
min296.785-296.568=0.218
max297.594-297.346=0.248
mean1937.000-1911.000=26.000
σ0.000
min1937.000-1911.000=26.000
max1937.000-1911.000=26.000
mean0.605-0.576=0.029
σ0.046-0.044=0.003
min0.519-0.515=0.004
max0.711-0.681=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.829=-0.007
σ0.040-0.043=-0.004
min286.773-286.774=-0.001
max286.865-286.873=-0.008
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.396-0.409=-0.012
σ0.007-0.014=-0.006
min0.388-0.386=0.001
max0.404-0.420=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1297.239-1297.258=-0.019
σ0.080-0.122=-0.042
min1297.144-1297.079=0.065
max1297.316-1297.408=-0.093
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean2.069-2.204=-0.136
σ0.082-0.018=0.064
min1.984-2.175=-0.191
max2.188-2.220=-0.032
iters=5
new-facts=6402
prior-facts=1
mean1541.302-1541.377=-0.075
σ6.839-6.837=0.001
min1538.052-1538.203=-0.151
max1553.531-1553.606=-0.076
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean2.150-2.331=-0.182
σ0.080-0.258=-0.178
min2.086-2.123=-0.037
max2.283-2.706=-0.423
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.113=0.002
σ0.080-0.063=0.017
min1859.000-1859.033=-0.034
max1859.193-1859.192=0.001
mean1791.800-1770.800=21.000
σ138.936-134.530=4.406
min1661.000-1642.000=19.000
max1937.000-1911.000=26.000
mean2.958-3.115=-0.158
σ0.151-0.243=-0.092
min2.702-2.867=-0.165
max3.101-3.456=-0.355

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.220=-0.017
σ0.312-0.356=-0.044
min0.932-0.935=-0.003
max1.715-1.832=-0.117

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.820=-0.001
σ581.373-581.372=0.001
min158.131-158.133=-0.002
max1320.878-1320.877=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean0.532-0.547=-0.014
σ0.541-0.554=-0.013
min0.260-0.260=-0.000
max1.344-1.378=-0.034
policies=20
mean1581.608-1581.610=-0.001
σ0.376-0.365=0.011
min1581.360-1581.362=-0.002
max1582.169-1582.152=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean2.669-2.644=0.025
σ0.047-0.025=0.022
min2.636-2.618=0.018
max2.738-2.674=0.064
policies=200
mean15824.014-15824.163=-0.149
σ0.116-0.126=-0.010
min15823.874-15824.006=-0.132
max15824.159-15824.312=-0.153
mean9200.000
σ0.000
min9200.000
max9200.000
mean1661.000-1642.000=19.000
σ0.000
min1661.000-1642.000=19.000
max1661.000-1642.000=19.000
mean26.705-26.589=0.116
σ0.089-0.069=0.020
min26.622-26.542=0.080
max26.808-26.691=0.117