Compare commits

Home / Compare 873d014a .. 6bfd4cb3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.053=0.001
σ0.370-0.371=-0.002
min53.905-53.906=-0.001
max55.106-55.109=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.139-0.140=-0.000
σ0.004-0.005=-0.000
min0.133-0.134=-0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.392-43.394=-0.002
σ0.005-0.007=-0.001
min43.387-43.384=0.003
max43.403-43.407=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.119-0.123=-0.004
σ0.004-0.004=-0.000
min0.115-0.120=-0.005
max0.125-0.131=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.005=0.000
σ1.192-1.190=0.002
min1006.431-1006.432=-0.001
max1012.001-1011.991=0.010
mean1051.500-1050.500=1.000
σ307.720-307.820=-0.099
min577.000-576.000=1.000
max1643.000-1644.000=-1.000
mean1.531-1.533=-0.002
σ0.078-0.077=0.000
min1.452-1.454=-0.001
max1.734-1.761=-0.027

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.423-0.425=-0.002
σ0.140-0.146=-0.005
min0.342-0.339=0.003
max0.672-0.684=-0.012
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=-0.001
min2.337
max2.342-2.343=-0.001
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.896-0.894=0.002
σ0.100-0.096=0.005
min0.839-0.833=0.007
max1.075-1.063=0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.543-0.534=0.009
σ0.050-0.059=-0.009
min0.502-0.491=0.011
max0.630-0.637=-0.007
name=nested_use.art
mean2.361-2.361=0.001
σ0.003-0.002=0.001
min2.360
max2.366-2.364=0.003
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.890-0.856=0.034
σ0.062-0.037=0.025
min0.824-0.832=-0.008
max0.979-0.921=0.058

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.838=0.001
σ0.034-0.032=0.002
min964.808-964.812=-0.004
max964.893-964.890=0.003
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.840-0.800=0.040
σ0.012-0.041=-0.029
min0.821-0.754=0.067
max0.851-0.852=-0.001
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.008-0.008=-0.000
min885.504
max885.523-885.523=-0.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.743-0.659=0.084
σ0.011-0.049=-0.038
min0.729-0.614=0.115
max0.755-0.737=0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean4.261-3.494=0.767
σ0.067-0.092=-0.025
min4.118-3.319=0.798
max4.552-4.069=0.483
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean4.283-4.070=0.213
σ0.089-0.283=-0.194
min4.148-3.421=0.728
max4.570-4.490=0.080
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.753-0.749=0.004
σ0.018-0.042=-0.024
min0.723-0.535=0.189
max0.860-0.856=0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.718-0.703=0.014
σ0.020-0.034=-0.014
min0.686-0.524=0.162
max0.806-0.787=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.012-297.020=-0.008
σ0.197-0.196=0.001
min296.816-296.865=-0.049
max297.501-297.541=-0.041
mean2094.000-1990.000=104.000
σ0.000
min2094.000-1990.000=104.000
max2094.000-1990.000=104.000
mean0.572-0.557=0.015
σ0.024-0.039=-0.015
min0.516-0.498=0.018
max0.599-0.592=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.821=0.004
σ0.037-0.036=0.001
min286.781-286.773=0.008
max286.866-286.865=0.001
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.396-0.396=-0.000
σ0.007-0.006=0.001
min0.389-0.389=-0.000
max0.405-0.402=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.259-1297.268=-0.009
σ0.088-0.089=-0.001
min1297.170-1297.167=0.003
max1297.382-1297.394=-0.013
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.137-2.036=0.101
σ0.206-0.064=0.142
min2.015-1.958=0.057
max2.499-2.109=0.390
iters=5
new-facts=6402
prior-facts=1
mean1541.310-1541.321=-0.011
σ6.840-6.857=-0.017
min1538.059-1538.060=-0.001
max1553.541-1553.582=-0.040
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.201-2.266=-0.065
σ0.108-0.178=-0.070
min2.104-2.174=-0.070
max2.374-2.584=-0.210
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.105=0.007
σ0.083-0.080=0.004
min1858.980-1858.980=-0.000
max1859.182-1859.183=-0.001
mean1790.400-1755.800=34.600
σ189.643-152.634=37.008
min1643.000-1644.000=-1.000
max2094.000-1990.000=104.000
mean2.959-3.015=-0.055
σ0.121-0.282=-0.161
min2.812-2.823=-0.011
max3.086-3.492=-0.406

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.197=-0.006
σ0.307-0.286=0.020
min0.932-0.936=-0.004
max1.541-1.661=-0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=-0.001
σ581.371-581.372=-0.001
min158.133-158.133=-0.000
max1320.876-1320.878=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.539-0.558=-0.019
σ0.547-0.585=-0.038
min0.264-0.260=0.005
max1.359-1.434=-0.075
policies=20
mean1581.619-1581.614=0.005
σ0.366-0.357=0.010
min1581.372-1581.376=-0.004
max1582.163-1582.145=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.648-2.629=0.019
σ0.013-0.016=-0.003
min2.635-2.610=0.025
max2.664-2.649=0.015
policies=200
mean15824.264-15824.181=0.083
σ0.129-0.106=0.022
min15824.164-15824.024=0.141
max15824.442-15824.254=0.188
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean26.577-26.573=0.004
σ0.059-0.068=-0.009
min26.506-26.509=-0.003
max26.650-26.638=0.011