Compare commits

Home / Compare b5b24bfe .. 2c9e2f8c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.967-54.014=-0.047
σ0.368-0.368=-0.000
min53.833-53.871=-0.038
max55.014-55.062=-0.048
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.151-0.138=0.013
σ0.013-0.006=0.007
min0.138-0.130=0.007
max0.170-0.146=0.024
cache=y
dps=1
iters=10
policies=100
mean43.328-43.321=0.007
σ0.007-0.008=-0.001
min43.318-43.315=0.003
max43.338-43.341=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.143-0.118=0.025
σ0.004-0.002=0.002
min0.140-0.115=0.025
max0.149-0.121=0.028

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.524-1006.307=0.216
σ1.163-1.179=-0.016
min1005.950-1005.768=0.182
max1011.379-1011.248=0.131
mean1034.900-1051.400=-16.500
σ309.947-306.992=2.955
min545.000-584.000=-39.000
max1501.000-1642.000=-141.000
mean1.526-1.566=-0.040
σ0.074-0.087=-0.013
min1.452-1.484=-0.032
max1.754-1.787=-0.034

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.436-0.419=0.018
σ0.131-0.152=-0.021
min0.334-0.323=0.011
max0.661-0.688=-0.027
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.873-0.933=-0.060
σ0.095-0.154=-0.059
min0.797-0.831=-0.035
max1.035-1.202=-0.167
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.529-0.548=-0.019
σ0.045-0.046=-0.001
min0.494-0.514=-0.019
max0.602-0.624=-0.022
name=nested_use.art
mean2.361-2.360=0.001
σ0.002-0.002=-0.000
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.838-0.837=0.000
σ0.039-0.037=0.002
min0.797-0.809=-0.012
max0.903-0.897=0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.826-964.113=0.713
σ0.035-0.035=0.000
min964.802-964.086=0.715
max964.886-964.171=0.715
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.847-0.795=0.052
σ0.018-0.065=-0.047
min0.815-0.684=0.131
max0.858-0.845=0.013
name=cdr_enhanced_4k_loc.art
mean885.509-884.713=0.796
σ0.005-0.001=0.004
min885.504-884.712=0.792
max885.513-884.715=0.799
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.706-0.733=-0.027
σ0.039-0.021=0.018
min0.639-0.695=-0.057
max0.734-0.747=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.714=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.719-7.718=0.002
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean4.233-3.500=0.732
σ0.108-0.087=0.021
min4.107-3.369=0.738
max4.923-3.833=1.089
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668-7.667=0.000
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean4.237-3.465=0.773
σ0.086-0.066=0.020
min4.083-3.344=0.739
max4.565-3.668=0.897
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.746-0.719=0.027
σ0.019-0.054=-0.035
min0.712-0.524=0.189
max0.865-0.847=0.018
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.704-0.499=0.205
σ0.015-0.013=0.003
min0.674-0.475=0.198
max0.767-0.546=0.222

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.507-296.401=0.106
σ0.202-0.192=0.010
min296.337-296.274=0.064
max297.035-296.933=0.102
mean2024.000-1904.000=120.000
σ0.000
min2024.000-1904.000=120.000
max2024.000-1904.000=120.000
mean0.561-0.568=-0.007
σ0.036-0.064=-0.028
min0.506-0.504=0.002
max0.597-0.706=-0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.026-284.690=0.336
σ0.038-0.035=0.002
min284.971-284.643=0.329
max285.064-284.727=0.337
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.395-0.399=-0.003
σ0.006-0.013=-0.007
min0.390-0.385=0.005
max0.405-0.418=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.428-1295.077=0.351
σ0.076-0.109=-0.033
min1295.357-1294.951=0.406
max1295.514-1295.204=0.310
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean2.077-1.934=0.143
σ0.084-0.108=-0.024
min2.002-1.809=0.193
max2.198-2.037=0.161
iters=5
new-facts=6402
prior-facts=1
mean1539.563-1539.192=0.371
σ6.812-6.883=-0.071
min1536.361-1535.918=0.444
max1551.746-1551.500=0.246
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean2.324-2.244=0.080
σ0.234-0.248=-0.015
min2.138-2.041=0.097
max2.711-2.621=0.090
iters=5
new-facts=6402
prior-facts=6402
mean1857.318-1856.985=0.333
σ0.070-0.052=0.018
min1857.210-1856.937=0.273
max1857.389-1857.061=0.328
mean1731.000-1772.600=-41.600
σ215.731-128.926=86.806
min1501.000-1642.000=-141.000
max2024.000-1904.000=120.000
mean2.878-3.044=-0.166
σ0.158-0.283=-0.125
min2.648-2.858=-0.210
max3.060-3.546=-0.486

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.680-1.189=0.490
σ0.137-0.296=-0.159
min1.455-0.941=0.513
max1.802-1.571=0.231

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-447.786=0.404
σ581.331-581.212=0.119
min157.523-157.179=0.344
max1320.186-1319.605=0.582
mean96.250
σ8.500
min92.000
max109.000
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean0.553-0.545=0.008
σ0.575-0.564=0.011
min0.262-0.261=0.001
max1.415-1.391=0.024
policies=20
mean1575.556-1572.102=3.454
σ0.354-0.353=0.001
min1575.315-1571.862=3.453
max1576.081-1572.626=3.455
mean920.000
σ0.000
min920.000
max920.000
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean2.631-2.628=0.004
σ0.017-0.010=0.007
min2.614-2.619=-0.005
max2.650-2.638=0.012
policies=200
mean15763.561-15728.953=34.609
σ0.204-0.182=0.022
min15763.282-15728.808=34.474
max15763.715-15729.219=34.496
mean9200.000
σ0.000
min9200.000
max9200.000
mean1501.000-1642.000=-141.000
σ0.000
min1501.000-1642.000=-141.000
max1501.000-1642.000=-141.000
mean26.494-26.634=-0.140
σ0.117-0.072=0.045
min26.383-26.556=-0.173
max26.640-26.726=-0.085