Compare commits

Home / Compare 7fed6173 .. 50b8c4cd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-53.964=0.091
σ0.370-0.368=0.002
min53.909-53.817=0.092
max55.108-55.012=0.096
mean416.000
σ0.000
min416.000
max416.000
mean0.141-0.139=0.002
σ0.007-0.004=0.003
min0.135-0.136=-0.001
max0.152-0.146=0.006
cache=y
dps=1
iters=10
policies=100
mean43.394-43.322=0.071
σ0.006-0.006=-0.000
min43.384-43.313=0.072
max43.406-43.337=0.068
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.123=-0.001
σ0.005-0.003=0.002
min0.114-0.119=-0.005
max0.131-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1006.515=0.489
σ1.209-1.183=0.025
min1006.449-1005.977=0.472
max1012.075-1011.461=0.614
mean1051.600-1062.300=-10.700
σ307.746-321.589=-13.842
min577.000-547.000=30.000
max1643.000-1528.000=115.000
mean1.545-1.574=-0.029
σ0.086-0.085=0.001
min1.398-1.496=-0.097
max1.758-1.825=-0.067

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.003-0.003=0.000
min0.882
max0.887
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.423-0.420=0.003
σ0.149-0.129=0.021
min0.334-0.349=-0.014
max0.688-0.649=0.039
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.003=0.001
min2.337
max2.344-2.342=0.002
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.888-0.880=0.008
σ0.097-0.088=0.009
min0.820-0.829=-0.009
max1.056-1.035=0.021
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.536-0.546=-0.010
σ0.046-0.050=-0.004
min0.495-0.488=0.007
max0.609-0.626=-0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.859-0.845=0.014
σ0.042-0.039=0.003
min0.821-0.804=0.017
max0.929-0.904=0.025

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.830=0.000
σ0.025-0.024=0.001
min964.802-964.812=-0.010
max964.862-964.869=-0.007
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.794-0.814=-0.020
σ0.087-0.049=0.038
min0.644-0.739=-0.095
max0.854-0.862=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.005-0.008=-0.003
min885.504
max885.517-885.521=-0.003
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.680-0.716=-0.035
σ0.048-0.013=0.035
min0.606-0.700=-0.095
max0.740-0.733=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean3.501-3.525=-0.024
σ0.096-0.086=0.010
min3.342-3.391=-0.049
max3.907-3.864=0.043
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.669=0.000
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean3.491-3.483=0.009
σ0.079-0.066=0.014
min3.364-3.276=0.087
max3.750-3.674=0.076
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.701-0.537=0.163
σ0.087-0.027=0.061
min0.514-0.514=-0.000
max0.840-0.750=0.090
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.504-0.508=-0.003
σ0.012-0.016=-0.004
min0.484-0.402=0.082
max0.562-0.561=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.018-296.447=0.571
σ0.181-0.260=-0.079
min296.801-296.281=0.520
max297.481-297.176=0.306
mean1951.000-2047.000=-96.000
σ0.000
min1951.000-2047.000=-96.000
max1951.000-2047.000=-96.000
mean0.599-0.548=0.051
σ0.013-0.030=-0.016
min0.587-0.510=0.077
max0.628-0.579=0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-285.027=1.797
σ0.040-0.038=0.002
min286.767-284.976=1.792
max286.866-285.066=1.800
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.395-0.395=-0.000
σ0.006-0.008=-0.002
min0.388-0.386=0.002
max0.400-0.407=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1297.286-1295.444=1.842
σ0.086-0.063=0.023
min1297.182-1295.364=1.817
max1297.410-1295.500=1.910
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean2.240-2.082=0.158
σ0.040-0.092=-0.052
min2.188-2.003=0.185
max2.295-2.215=0.081
iters=5
new-facts=6402
prior-facts=1
mean1541.338-1539.526=1.812
σ6.817-6.846=-0.029
min1538.122-1536.266=1.856
max1553.530-1551.768=1.761
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean2.214-2.281=-0.067
σ0.079-0.214=-0.135
min2.125-2.063=0.062
max2.339-2.587=-0.248
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1857.320=1.799
σ0.069-0.077=-0.008
min1859.033-1857.211=1.822
max1859.199-1857.408=1.790
mean1791.200-1763.800=27.400
σ154.545-210.997=-56.452
min1643.000-1528.000=115.000
max1951.000-2047.000=-96.000
mean2.938-3.021=-0.082
σ0.103-0.070=0.033
min2.815-2.928=-0.113
max3.039-3.112=-0.073

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.358-1.493=-0.135
σ0.350-0.279=0.071
min0.930-1.165=-0.235
max1.877-1.763=0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.191=0.630
σ581.372-581.332=0.040
min158.134-157.521=0.613
max1320.879-1320.189=0.691
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean0.568-0.537=0.031
σ0.608-0.550=0.058
min0.260-0.261=-0.000
max1.479-1.362=0.118
policies=20
mean1581.630-1575.571=6.059
σ0.380-0.359=0.021
min1581.377-1575.333=6.044
max1582.196-1576.105=6.091
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean2.659-2.638=0.021
σ0.043-0.018=0.026
min2.621-2.617=0.004
max2.721-2.658=0.063
policies=200
mean15824.164-15763.709=60.455
σ0.100-0.005=0.095
min15824.020-15763.705=60.315
max15824.249-15763.715=60.534
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1528.000=115.000
σ0.000
min1643.000-1528.000=115.000
max1643.000-1528.000=115.000
mean26.699-26.597=0.103
σ0.068-0.052=0.016
min26.651-26.543=0.108
max26.795-26.654=0.141