Compare commits

Home / Compare 6ad8a9ce .. a39df534

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.053=0.002
σ0.369-0.371=-0.002
min53.913-53.907=0.006
max55.104-55.109=-0.005
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.141-0.136=0.005
σ0.004-0.004=-0.000
min0.136-0.132=0.004
max0.147-0.142=0.005
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.000
σ0.007-0.006=0.001
min43.382-43.384=-0.003
max43.404-43.403=0.001
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.121-0.121=0.001
σ0.004-0.005=-0.001
min0.117-0.115=0.001
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.009=-0.003
σ1.188-1.182=0.006
min1006.432-1006.433=-0.000
max1011.982-1011.954=0.028
mean1059.200-1052.350=6.850
σ306.966-307.919=-0.953
min581.000-577.000=4.000
max1625.000-1644.000=-19.000
mean1.532-1.536=-0.004
σ0.074-0.097=-0.023
min1.475-1.452=0.023
max1.779-1.804=-0.025

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.406-0.432=-0.026
σ0.106-0.143=-0.037
min0.334-0.352=-0.019
max0.590-0.687=-0.096
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.885-0.890=-0.005
σ0.086-0.094=-0.008
min0.816-0.827=-0.012
max1.035-1.053=-0.018
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.547-0.546=0.001
σ0.050-0.055=-0.005
min0.508-0.500=0.008
max0.629-0.634=-0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.854-0.854=-0.000
σ0.040-0.037=0.003
min0.821-0.822=-0.000
max0.921-0.908=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.034-0.034=-0.000
min964.811
max964.895-964.892=0.003
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.843-0.839=0.004
σ0.018-0.037=-0.019
min0.818-0.774=0.044
max0.862-0.864=-0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=-0.001
min885.504-885.505=-0.001
max885.520-885.523=-0.002
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.726-0.697=0.029
σ0.018-0.043=-0.025
min0.698-0.642=0.056
max0.742-0.740=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.722=-0.000
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean4.288-4.256=0.032
σ0.091-0.096=-0.005
min4.114-4.101=0.013
max4.544-4.662=-0.118
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean4.172-4.245=-0.073
σ0.276-0.080=0.196
min3.430-4.127=-0.698
max4.515-4.521=-0.007
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.748-0.758=-0.010
σ0.016-0.018=-0.001
min0.716-0.726=-0.010
max0.819-0.877=-0.058
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.713-0.719=-0.006
σ0.017-0.015=0.002
min0.639-0.685=-0.046
max0.780-0.801=-0.021

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.934-296.917=0.017
σ0.222-0.266=-0.044
min296.595-296.710=-0.115
max297.330-297.636=-0.306
mean1908.000-1913.000=-5.000
σ0.000
min1908.000-1913.000=-5.000
max1908.000-1913.000=-5.000
mean0.599-0.585=0.014
σ0.040-0.043=-0.003
min0.528-0.534=-0.006
max0.687-0.684=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-286.829=-0.005
σ0.035-0.033=0.002
min286.775-286.793=-0.018
max286.859-286.865=-0.006
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.397-0.409=-0.013
σ0.006-0.011=-0.005
min0.390-0.395=-0.006
max0.402-0.425=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1297.290-1297.229=0.061
σ0.081-0.079=0.002
min1297.199-1297.131=0.068
max1297.410-1297.307=0.103
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean2.234-2.062=0.172
σ0.018-0.069=-0.051
min2.211-1.984=0.226
max2.258-2.134=0.124
iters=5
new-facts=6402
prior-facts=1
mean1541.337-1541.402=-0.066
σ6.825-6.836=-0.011
min1538.118-1538.167=-0.049
max1553.543-1553.628=-0.084
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean2.220-2.370=-0.151
σ0.108-0.205=-0.097
min2.124-2.105=0.019
max2.402-2.651=-0.250
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.115=0.002
σ0.066-0.085=-0.019
min1859.028-1858.996=0.032
max1859.199-1859.198=0.001
mean1770.400-1777.200=-6.800
σ134.849-131.532=3.317
min1625.000-1644.000=-19.000
max1908.000-1913.000=-5.000
mean3.165-3.086=0.080
σ0.359-0.200=0.159
min2.867-2.855=0.012
max3.737-3.312=0.424

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.243-1.241=0.002
σ0.368-0.337=0.031
min0.946-0.930=0.017
max1.871-1.701=0.169

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.822=-0.002
σ581.372-581.372=0.000
min158.132-158.135=-0.003
max1320.878-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean0.559-0.565=-0.006
σ0.578-0.602=-0.025
min0.267-0.258=0.009
max1.425-1.469=-0.044
policies=20
mean1581.615-1581.632=-0.018
σ0.367-0.363=0.004
min1581.370-1581.390=-0.020
max1582.161-1582.172=-0.012
mean920.000
σ0.000
min920.000
max920.000
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean2.646-2.647=-0.001
σ0.011-0.015=-0.004
min2.633-2.628=0.004
max2.657-2.666=-0.009
policies=200
mean15824.192-15824.263=-0.071
σ0.150-0.086=0.064
min15823.994-15824.165=-0.170
max15824.357-15824.373=-0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1625.000-1644.000=-19.000
σ0.000
min1625.000-1644.000=-19.000
max1625.000-1644.000=-19.000
mean26.668-26.613=0.055
σ0.042-0.100=-0.058
min26.625-26.499=0.126
max26.723-26.718=0.005