Compare commits

Home / Compare 82e7e559 .. 3e3a955d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-53.962=0.093
σ0.370-0.368=0.002
min53.907-53.817=0.089
max55.107-55.009=0.098
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.141-0.137=0.005
σ0.005-0.005=-0.001
min0.137-0.128=0.008
max0.148-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.392-43.322=0.070
σ0.006-0.005=0.002
min43.383-43.314=0.069
max43.403-43.333=0.070
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.120-0.121=-0.000
σ0.004-0.005=-0.001
min0.117-0.113=0.004
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1006.515=0.487
σ1.208-1.164=0.044
min1006.462-1005.949=0.512
max1012.070-1011.391=0.679
mean1055.050-1050.450=4.600
σ320.432-310.212=10.220
min574.000-556.000=18.000
max1623.000-1520.000=103.000
mean1.554-1.525=0.029
σ0.145-0.060=0.085
min1.369-1.412=-0.043
max2.087-1.667=0.420

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.415-0.430=-0.015
σ0.124-0.152=-0.028
min0.343-0.339=0.005
max0.634-0.699=-0.066
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.881-0.894=-0.014
σ0.088-0.131=-0.042
min0.815-0.816=-0.001
max1.035-1.126=-0.091
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.534-0.535=-0.000
σ0.042-0.041=0.000
min0.500-0.508=-0.007
max0.604-0.608=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.836-0.853=-0.017
σ0.047-0.044=0.004
min0.801-0.826=-0.025
max0.917-0.930=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.831=0.005
σ0.030-0.021=0.009
min964.810-964.812=-0.002
max964.886-964.860=0.025
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.814-0.824=-0.010
σ0.037-0.031=0.006
min0.772-0.776=-0.004
max0.853-0.858=-0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.001
σ0.008-0.008=-0.001
min885.505-885.504=0.001
max885.524-885.522=0.002
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.723-0.722=0.002
σ0.033-0.028=0.005
min0.668-0.675=-0.007
max0.756-0.740=0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.723-7.719=0.004
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean4.214-4.211=0.003
σ0.085-0.102=-0.017
min4.051-4.073=-0.023
max4.612-4.645=-0.034
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.670=-0.003
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean4.199-4.180=0.018
σ0.081-0.059=0.022
min4.069-4.071=-0.002
max4.506-4.378=0.128
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.740-0.737=0.003
σ0.016-0.017=-0.001
min0.714-0.708=0.006
max0.830-0.841=-0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.698-0.688=0.010
σ0.015-0.018=-0.003
min0.672-0.561=0.111
max0.769-0.714=0.055

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.116-296.434=0.682
σ0.177-0.257=-0.080
min296.924-296.219=0.705
max297.541-297.129=0.412
mean1899.000-2019.000=-120.000
σ0.000
min1899.000-2019.000=-120.000
max1899.000-2019.000=-120.000
mean0.589-0.594=-0.005
σ0.023-0.006=0.017
min0.535-0.581=-0.046
max0.617-0.599=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-285.035=1.785
σ0.040-0.038=0.001
min286.760-284.986=1.775
max286.857-285.079=1.779
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.395-0.397=-0.003
σ0.006-0.012=-0.006
min0.389-0.385=0.004
max0.401-0.414=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1297.280-1295.412=1.869
σ0.083-0.112=-0.029
min1297.185-1295.290=1.894
max1297.401-1295.548=1.854
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean2.228-1.889=0.339
σ0.016-0.102=-0.085
min2.206-1.797=0.409
max2.244-2.024=0.220
iters=5
new-facts=6402
prior-facts=1
mean1541.317-1539.527=1.790
σ6.830-6.856=-0.025
min1538.078-1536.233=1.845
max1553.532-1551.786=1.746
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean2.174-2.290=-0.116
σ0.153-0.236=-0.083
min1.972-2.041=-0.069
max2.368-2.573=-0.205
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1857.314=1.798
σ0.068-0.064=0.003
min1859.030-1857.236=1.794
max1859.193-1857.396=1.797
mean1765.600-1735.000=30.600
σ129.502-207.556=-78.054
min1623.000-1520.000=103.000
max1899.000-2019.000=-120.000
mean3.062-2.894=0.168
σ0.312-0.069=0.243
min2.753-2.833=-0.080
max3.514-2.970=0.544

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.303-1.417=-0.114
σ0.295-0.331=-0.036
min1.065-0.971=0.093
max1.718-1.810=-0.092

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.191=0.631
σ581.372-581.331=0.041
min158.134-157.524=0.611
max1320.880-1320.187=0.693
mean96.250
σ8.500
min92.000
max109.000
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean0.546-0.549=-0.003
σ0.560-0.580=-0.020
min0.264-0.259=0.006
max1.386-1.419=-0.033
policies=20
mean1581.634-1575.571=6.063
σ0.371-0.357=0.014
min1581.385-1575.332=6.053
max1582.187-1576.103=6.084
mean920.000
σ0.000
min920.000
max920.000
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean2.660-2.634=0.026
σ0.019-0.010=0.009
min2.636-2.620=0.016
max2.676-2.642=0.034
policies=200
mean15824.177-15763.663=60.514
σ0.153-0.160=-0.006
min15824.058-15763.556=60.503
max15824.402-15763.899=60.503
mean9200.000
σ0.000
min9200.000
max9200.000
mean1623.000-1520.000=103.000
σ0.000
min1623.000-1520.000=103.000
max1623.000-1520.000=103.000
mean26.813-26.465=0.349
σ0.084-0.032=0.052
min26.764-26.432=0.331
max26.938-26.508=0.430