Compare commits

Home / Compare a6f8512f .. cb5e6c43

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.001
σ0.369-0.369=-0.000
min53.910-53.908=0.002
max55.107-55.105=0.001
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.142-0.142=-0.001
σ0.004-0.004=0.000
min0.138-0.139=-0.001
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.001
σ0.006-0.007=-0.001
min43.383-43.384=-0.001
max43.401-43.407=-0.006
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.121-0.118=0.002
σ0.006-0.005=0.001
min0.114-0.115=-0.001
max0.132-0.129=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.005=0.001
σ1.188-1.207=-0.020
min1006.433-1006.431=0.001
max1011.982-1012.065=-0.082
mean1047.950-1056.700=-8.750
σ306.673-313.846=-7.173
min588.000-587.000=1.000
max1648.000-1617.000=31.000
mean1.553-1.536=0.017
σ0.076-0.085=-0.009
min1.389-1.465=-0.076
max1.679-1.835=-0.156

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.415-0.426=-0.012
σ0.134-0.104=0.030
min0.327-0.360=-0.033
max0.652-0.609=0.043
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.885-0.889=-0.004
σ0.085-0.059=0.025
min0.829-0.844=-0.014
max1.034-0.991=0.043
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.528-0.539=-0.012
σ0.046-0.045=0.001
min0.494-0.503=-0.009
max0.607-0.614=-0.008
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.846-0.852=-0.006
σ0.036-0.047=-0.011
min0.808-0.805=0.003
max0.902-0.930=-0.028

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.840=-0.000
σ0.034-0.021=0.013
min964.812-964.825=-0.013
max964.895-964.877=0.019
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.815-0.856=-0.042
σ0.042-0.022=0.020
min0.777-0.827=-0.050
max0.861-0.877=-0.016
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.000
min885.505
max885.523-885.523=0.000
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.722-0.733=-0.011
σ0.030-0.042=-0.012
min0.668-0.661=0.008
max0.736-0.766=-0.030

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean3.508-4.302=-0.795
σ0.075-0.093=-0.018
min3.378-4.143=-0.765
max3.825-4.757=-0.932
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean3.470-4.286=-0.816
σ0.061-0.092=-0.031
min3.363-4.104=-0.741
max3.713-4.644=-0.931
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.740-0.754=-0.014
σ0.021-0.016=0.005
min0.625-0.730=-0.105
max0.835-0.856=-0.021
name=record_render_syntax_err.art
mean2.166-2.166=-0.000
σ0.002-0.002=0.000
min2.165
max2.169
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.700-0.719=-0.020
σ0.016-0.014=0.002
min0.668-0.694=-0.026
max0.778-0.787=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.879-297.042=-0.163
σ0.222-0.207=0.015
min296.717-296.862=-0.145
max297.493-297.600=-0.107
mean2031.000-1899.000=132.000
σ0.000
min2031.000-1899.000=132.000
max2031.000-1899.000=132.000
mean0.574-0.569=0.006
σ0.034-0.050=-0.017
min0.510-0.523=-0.013
max0.605-0.692=-0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.827=-0.008
σ0.037-0.039=-0.002
min286.771-286.778=-0.008
max286.859-286.868=-0.009
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.396-0.396=0.000
σ0.005-0.009=-0.004
min0.390-0.388=0.002
max0.403-0.409=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1297.273-1297.261=0.011
σ0.093-0.094=-0.001
min1297.139-1297.126=0.014
max1297.386-1297.375=0.011
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean2.253-2.227=0.027
σ0.070-0.020=0.051
min2.174-2.210=-0.035
max2.366-2.254=0.113
iters=5
new-facts=6402
prior-facts=1
mean1541.362-1541.375=-0.013
σ6.807-6.803=0.004
min1538.182-1538.235=-0.053
max1553.537-1553.543=-0.006
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean2.277-2.332=-0.055
σ0.212-0.250=-0.038
min2.101-2.166=-0.064
max2.608-2.754=-0.146
iters=5
new-facts=6402
prior-facts=6402
mean1859.125-1859.116=0.010
σ0.057-0.063=-0.006
min1859.040-1859.031=0.009
max1859.177-1859.190=-0.013
mean1782.000-1764.000=18.000
σ166.384-131.564=34.820
min1648.000-1617.000=31.000
max2031.000-1899.000=132.000
mean2.935-3.131=-0.196
σ0.167-0.256=-0.089
min2.676-2.893=-0.217
max3.103-3.498=-0.395

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.232-1.158=0.074
σ0.270-0.250=0.020
min0.930-0.941=-0.011
max1.567-1.534=0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=-0.000
σ581.372-581.372=-0.000
min158.133-158.134=-0.001
max1320.879-1320.879=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean0.554-0.537=0.017
σ0.576-0.543=0.033
min0.264-0.263=0.001
max1.418-1.351=0.066
policies=20
mean1581.610-1581.633=-0.023
σ0.359-0.369=-0.010
min1581.371-1581.389=-0.018
max1582.143-1582.182=-0.039
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean2.645-2.649=-0.004
σ0.016-0.012=0.004
min2.629-2.634=-0.004
max2.662-2.662=-0.000
policies=200
mean15824.114-15824.242=-0.129
σ0.140-0.091=0.049
min15823.966-15824.157=-0.192
max15824.255-15824.359=-0.105
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1617.000=31.000
σ0.000
min1648.000-1617.000=31.000
max1648.000-1617.000=31.000
mean26.709-26.631=0.078
σ0.091-0.090=0.001
min26.621-26.544=0.076
max26.788-26.734=0.054