Compare commits

Home / Compare 9707b450 .. 671788d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.057=0.000
σ0.368-0.367=0.001
min53.917-53.913=0.004
max55.104-55.101=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.139-0.138=0.001
σ0.005-0.006=-0.001
min0.132-0.130=0.002
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.396-43.394=0.002
σ0.008-0.006=0.002
min43.388-43.385=0.003
max43.414-43.402=0.012
mean415.000
σ0.000
min415.000
max415.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.120-0.119=0.001
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.960-1006.967=-0.007
σ0.878-0.857=0.021
min1006.463-1006.463=0.000
max1010.595-1010.498=0.097
mean1049.300-1048.850=0.450
σ313.189-310.190=2.999
min563.000-553.000=10.000
max1648.000-1642.000=6.000
mean1.536-1.534=0.002
σ0.059-0.074=-0.015
min1.470-1.465=0.005
max1.671-1.764=-0.092

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.411-0.417=-0.006
σ0.124-0.141=-0.016
min0.337-0.330=0.006
max0.630-0.665=-0.035
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.879-0.884=-0.005
σ0.099-0.104=-0.005
min0.810-0.806=0.004
max1.049-1.064=-0.015
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.525-0.545=-0.020
σ0.053-0.060=-0.007
min0.487-0.498=-0.011
max0.617-0.645=-0.029
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.002=-0.000
min2.360
max2.364
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.845-0.847=-0.002
σ0.045-0.048=-0.003
min0.805-0.815=-0.010
max0.918-0.929=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.840=-0.002
σ0.035-0.034=0.001
min964.810-964.812=-0.002
max964.897-964.897=0.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.835-0.850=-0.015
σ0.034-0.024=0.010
min0.781-0.809=-0.028
max0.863-0.872=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.007-0.006=0.001
min885.505-885.504=0.001
max885.522-885.521=0.001
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.737-0.701=0.036
σ0.010-0.037=-0.027
min0.726-0.663=0.063
max0.749-0.741=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean3.986-4.179=-0.193
σ0.349-0.093=0.256
min3.405-4.026=-0.620
max4.491-4.519=-0.027
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean3.494-4.192=-0.699
σ0.077-0.068=0.010
min3.377-4.053=-0.676
max3.702-4.420=-0.718
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.691-0.745=-0.054
σ0.093-0.019=0.074
min0.515-0.717=-0.202
max0.850-0.871=-0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.505-0.705=-0.201
σ0.012-0.018=-0.005
min0.482-0.674=-0.192
max0.549-0.821=-0.272

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.384-295.328=0.055
σ0.297-0.163=0.134
min295.175-295.073=0.102
max296.188-295.667=0.521
mean1896.000-2030.000=-134.000
σ0.000
min1896.000-2030.000=-134.000
max1896.000-2030.000=-134.000
mean0.579-0.531=0.047
σ0.052-0.027=0.025
min0.502-0.502=0.000
max0.689-0.572=0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.389-285.402=-0.013
σ0.032-0.036=-0.004
min285.348-285.350=-0.002
max285.434-285.442=-0.008
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.388-0.399=-0.011
σ0.009-0.014=-0.005
min0.381-0.379=0.002
max0.403-0.415=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.782-1295.784=-0.002
σ0.118-0.119=-0.002
min1295.661-1295.648=0.013
max1295.933-1295.933=0.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean1.921-1.873=0.048
σ0.106-0.061=0.045
min1.803-1.817=-0.014
max2.039-1.941=0.098
iters=5
new-facts=6402
prior-facts=1
mean1539.906-1539.908=-0.002
σ6.847-6.888=-0.041
min1536.627-1536.641=-0.014
max1552.152-1552.226=-0.074
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean2.227-2.214=0.013
σ0.275-0.160=0.115
min2.029-2.031=-0.002
max2.684-2.397=0.287
iters=5
new-facts=6402
prior-facts=6402
mean1857.682-1857.680=0.001
σ0.070-0.063=0.007
min1857.593-1857.617=-0.024
max1857.770-1857.766=0.004
mean1767.800-1777.600=-9.800
σ122.304-170.400=-48.097
min1648.000-1642.000=6.000
max1896.000-2030.000=-134.000
mean3.017-2.871=0.147
σ0.177-0.036=0.141
min2.850-2.824=0.027
max3.284-2.916=0.368

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.200-1.234=-0.035
σ0.378-0.355=0.024
min0.939-0.937=0.002
max1.850-1.831=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.708-445.707=0.000
σ580.934-580.934=0.000
min155.239-155.239=-0.000
max1317.108-1317.108=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.546-0.537=0.009
σ0.573-0.562=0.011
min0.257-0.249=0.008
max1.406-1.380=0.026
policies=20
mean1552.658-1552.653=0.005
σ0.331-0.317=0.014
min1552.428-1552.433=-0.006
max1553.149-1553.124=0.026
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean2.586-2.578=0.009
σ0.020-0.013=0.007
min2.561-2.566=-0.005
max2.605-2.596=0.009
policies=200
mean15534.624-15534.741=-0.117
σ0.112-0.062=0.050
min15534.531-15534.689=-0.157
max15534.787-15534.810=-0.023
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean26.166-25.982=0.184
σ0.158-0.155=0.003
min26.053-25.797=0.255
max26.400-26.177=0.223