Compare commits

Home / Compare a2450ea1 .. 96093aa8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.368-0.369=-0.000
min53.912-53.912=-0.000
max55.102-55.103=-0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.141-0.141=-0.000
σ0.004-0.004=0.000
min0.138-0.137=0.001
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.006=0.000
min43.386-43.385=0.001
max43.403-43.402=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.121=0.001
σ0.005-0.004=0.001
min0.116-0.118=-0.002
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.011-1007.001=0.010
σ1.172-1.204=-0.033
min1006.434-1006.462=-0.028
max1011.907-1012.052=-0.146
mean1057.000-1052.150=4.850
σ306.994-304.685=2.309
min579.000-591.000=-12.000
max1622.000-1452.000=170.000
mean1.525-1.545=-0.020
σ0.073-0.090=-0.017
min1.402-1.377=0.024
max1.735-1.764=-0.030

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.422-0.349=0.073
σ0.119-0.099=0.020
min0.352-0.255=0.096
max0.633-0.508=0.125
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.889-0.891=-0.002
σ0.089-0.093=-0.004
min0.816-0.817=-0.001
max1.042-1.052=-0.010
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.003=-0.001
min1.522
max1.526-1.528=-0.002
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.536-0.539=-0.003
σ0.054-0.045=0.008
min0.484-0.495=-0.012
max0.621-0.609=0.011
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.853-0.855=-0.002
σ0.049-0.040=0.009
min0.814-0.826=-0.012
max0.935-0.921=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.824=0.016
σ0.034-0.029=0.004
min964.811-964.802=0.009
max964.895-964.873=0.022
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.848-0.825=0.023
σ0.017-0.043=-0.026
min0.821-0.753=0.068
max0.864-0.859=0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.007-0.006=0.001
min885.504
max885.522-885.518=0.004
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.714-0.714=0.000
σ0.026-0.025=0.001
min0.673-0.675=-0.003
max0.738-0.742=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean4.274-4.244=0.029
σ0.090-0.083=0.007
min4.141-4.104=0.037
max4.550-4.537=0.013
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean4.244-4.221=0.023
σ0.084-0.078=0.005
min4.110-4.102=0.007
max4.506-4.556=-0.050
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.749-0.636=0.113
σ0.020-0.109=-0.089
min0.664-0.510=0.154
max0.848-0.870=-0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.705-0.512=0.193
σ0.015-0.035=-0.020
min0.679-0.487=0.192
max0.788-0.757=0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.854-296.798=0.056
σ0.206-0.277=-0.071
min296.649-296.638=0.011
max297.400-297.571=-0.170
mean2031.000-1920.000=111.000
σ0.000
min2031.000-1920.000=111.000
max2031.000-1920.000=111.000
mean0.559-0.586=-0.027
σ0.026-0.049=-0.023
min0.515-0.505=0.010
max0.590-0.671=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.829=-0.008
σ0.038-0.037=0.001
min286.768-286.782=-0.015
max286.857-286.871=-0.014
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.398-0.403=-0.005
σ0.007-0.013=-0.006
min0.389-0.391=-0.002
max0.404-0.424=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1297.237-1297.256=-0.019
σ0.051-0.091=-0.040
min1297.191-1297.137=0.054
max1297.294-1297.368=-0.074
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean2.090-2.191=-0.101
σ0.066-0.095=-0.029
min2.036-2.073=-0.036
max2.201-2.329=-0.127
iters=5
new-facts=6402
prior-facts=1
mean1541.349-1541.360=-0.011
σ6.815-6.819=-0.005
min1538.155-1538.183=-0.028
max1553.537-1553.557=-0.020
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean2.277-2.274=0.003
σ0.261-0.225=0.036
min2.067-2.069=-0.002
max2.719-2.637=0.082
iters=5
new-facts=6402
prior-facts=6402
mean1859.110-1859.110=0.000
σ0.084-0.069=0.016
min1858.978-1859.036=-0.058
max1859.181-1859.183=-0.002
mean1776.200-1735.600=40.600
σ176.893-195.482=-18.589
min1622.000-1470.000=152.000
max2031.000-1920.000=111.000
mean3.042-3.059=-0.017
σ0.281-0.115=0.167
min2.804-2.927=-0.122
max3.510-3.239=0.271

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.235-1.685=-0.450
σ0.372-0.149=0.223
min0.938-1.565=-0.627
max1.849-1.886=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=0.000
min158.135-158.134=0.000
max1320.880-1320.879=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean0.553-0.550=0.003
σ0.573-0.561=0.011
min0.260-0.266=-0.006
max1.412-1.392=0.020
policies=20
mean1581.615-1581.607=0.008
σ0.355-0.359=-0.004
min1581.375-1581.379=-0.004
max1582.143-1582.142=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean2.629-2.642=-0.013
σ0.015-0.013=0.002
min2.618-2.630=-0.011
max2.651-2.656=-0.006
policies=200
mean15824.274-15824.195=0.079
σ0.139-0.168=-0.029
min15824.141-15824.025=0.116
max15824.458-15824.425=0.033
mean9200.000
σ0.000
min9200.000
max9200.000
mean1622.000-1452.000=170.000
σ0.000
min1622.000-1452.000=170.000
max1622.000-1452.000=170.000
mean26.583-26.654=-0.071
σ0.111-0.050=0.061
min26.492-26.599=-0.107
max26.724-26.716=0.007