Compare commits

Home / Compare 69ac79dc .. 5266b20e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.045=0.000
σ0.368-0.369=-0.001
min53.903-53.906=-0.003
max55.092-55.095=-0.002
mean415.800-415.000=0.800
σ0.422-0.000=0.422
min415.000
max416.000-415.000=1.000
mean0.138-0.138=0.001
σ0.005-0.005=0.000
min0.131-0.132=-0.001
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.002
σ0.006-0.007=-0.001
min43.376-43.374=0.001
max43.394-43.399=-0.006
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.122=0.000
σ0.005-0.004=0.000
min0.116-0.115=0.000
max0.131-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.983-1006.981=0.002
σ0.853-0.864=-0.011
min1006.482-1006.492=-0.010
max1010.495-1010.551=-0.056
mean1044.400-1051.000=-6.600
σ313.668-310.314=3.353
min576.000-575.000=1.000
max1638.000-1647.000=-9.000
mean1.557-1.553=0.005
σ0.082-0.070=0.012
min1.485-1.475=0.011
max1.822-1.752=0.070

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.003-0.003=0.000
min0.882
max0.888-0.887=0.001
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.419-0.432=-0.013
σ0.146-0.186=-0.041
min0.338-0.334=0.004
max0.678-0.765=-0.087
name=error_case.art
mean2.340-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.344-2.342=0.002
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.875-0.930=-0.054
σ0.086-0.138=-0.053
min0.819-0.820=-0.002
max1.025-1.151=-0.126
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.535-0.530=0.005
σ0.052-0.044=0.007
min0.495-0.494=0.002
max0.624-0.603=0.021
name=nested_use.art
mean2.362-2.361=0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.836-0.821=0.016
σ0.040-0.037=0.003
min0.809-0.792=0.017
max0.907-0.881=0.026

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.835=-0.007
σ0.024-0.029=-0.005
min964.802-964.811=-0.009
max964.862-964.884=-0.022
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.805-0.810=-0.005
σ0.054-0.049=0.005
min0.727-0.744=-0.017
max0.856-0.856=-0.000
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.006-0.004=0.001
min885.505-885.509=-0.004
max885.519-885.519=0.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.687-0.711=-0.025
σ0.052-0.044=0.008
min0.609-0.652=-0.043
max0.734-0.746=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean3.484-4.198=-0.714
σ0.072-0.080=-0.009
min3.367-4.054=-0.688
max3.851-4.586=-0.735
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean3.486-4.228=-0.743
σ0.061-0.079=-0.018
min3.369-4.087=-0.718
max3.690-4.455=-0.765
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.733-0.735=-0.002
σ0.022-0.033=-0.011
min0.670-0.564=0.106
max0.836-0.903=-0.067
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.698-0.693=0.005
σ0.017-0.016=0.001
min0.657-0.667=-0.011
max0.780-0.792=-0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.471-295.611=-0.140
σ0.233-0.236=-0.003
min295.314-295.397=-0.083
max296.075-296.222=-0.148
mean1904.000-1975.000=-71.000
σ0.000
min1904.000-1975.000=-71.000
max1904.000-1975.000=-71.000
mean0.585-0.568=0.017
σ0.041-0.031=0.010
min0.507-0.497=0.011
max0.641-0.599=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.411=0.002
σ0.036-0.037=-0.000
min285.368-285.361=0.006
max285.453-285.448=0.005
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.389-0.387=0.002
σ0.012-0.009=0.002
min0.379-0.379=0.001
max0.406-0.402=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.798-1295.797=0.001
σ0.112-0.101=0.011
min1295.671-1295.677=-0.006
max1295.930-1295.899=0.031
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean1.966-1.906=0.061
σ0.190-0.090=0.100
min1.817-1.813=0.005
max2.282-2.040=0.242
iters=5
new-facts=6402
prior-facts=1
mean1539.931-1539.932=-0.001
σ6.852-6.858=-0.006
min1536.655-1536.629=0.026
max1552.182-1552.196=-0.014
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean2.300-2.232=0.067
σ0.243-0.187=0.057
min2.034-2.056=-0.022
max2.590-2.534=0.056
iters=5
new-facts=6402
prior-facts=6402
mean1857.704-1857.704=0.000
σ0.054-0.060=-0.007
min1857.649-1857.634=0.015
max1857.779-1857.792=-0.013
mean1772.800-1782.800=-10.000
σ130.325-128.032=2.293
min1638.000-1647.000=-9.000
max1904.000-1975.000=-71.000
mean3.046-2.907=0.140
σ0.241-0.100=0.141
min2.851-2.773=0.078
max3.453-3.025=0.427

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.352-1.326=0.026
σ0.274-0.262=0.012
min1.103-1.102=0.001
max1.822-1.776=0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.741=-0.002
σ580.935-580.935=0.000
min155.269-155.272=-0.003
max1317.141-1317.143=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean0.542-0.537=0.005
σ0.568-0.558=0.010
min0.257-0.256=0.001
max1.393-1.374=0.020
policies=20
mean1552.977-1552.980=-0.003
σ0.319-0.321=-0.002
min1552.749-1552.766=-0.017
max1553.450-1553.458=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean2.577-2.590=-0.013
σ0.016-0.018=-0.002
min2.565-2.566=-0.001
max2.600-2.603=-0.003
policies=200
mean15537.936-15537.951=-0.015
σ0.067-0.209=-0.141
min15537.845-15537.735=0.110
max15538.000-15538.216=-0.216
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1647.000=-9.000
σ0.000
min1638.000-1647.000=-9.000
max1638.000-1647.000=-9.000
mean26.085-26.149=-0.065
σ0.115-0.121=-0.005
min25.967-26.036=-0.069
max26.219-26.307=-0.088