Compare commits

Home / Compare 23ce7c93 .. 365fbc09

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.369-0.370=-0.001
min53.913-53.911=0.001
max55.106-55.108=-0.001
mean420.000-419.000=1.000
σ0.000
min420.000-419.000=1.000
max420.000-419.000=1.000
mean0.138-0.140=-0.002
σ0.005-0.005=-0.000
min0.130-0.133=-0.003
max0.144-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.001
σ0.006-0.007=-0.001
min43.385-43.385=0.000
max43.405-43.409=-0.004
mean420.000-419.000=1.000
σ0.000
min420.000-419.000=1.000
max420.000-419.000=1.000
mean0.124-0.122=0.002
σ0.004-0.004=-0.000
min0.120-0.119=0.001
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1007.004=-0.028
σ0.874-1.200=-0.326
min1006.482-1006.444=0.038
max1010.602-1012.035=-1.433
mean1058.350-1053.100=5.250
σ319.933-307.943=11.991
min582.000-580.000=2.000
max1626.000-1643.000=-17.000
mean1.549-1.538=0.011
σ0.086-0.071=0.015
min1.463-1.472=-0.009
max1.863-1.753=0.110

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.419-0.421=-0.002
σ0.148-0.149=-0.000
min0.331-0.331=0.001
max0.683-0.685=-0.002
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.881-0.886=-0.005
σ0.110-0.088=0.022
min0.820-0.826=-0.006
max1.076-1.042=0.034
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.564-0.542=0.022
σ0.065-0.041=0.023
min0.503-0.516=-0.014
max0.635-0.615=0.020
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.846-0.844=0.002
σ0.044-0.046=-0.002
min0.815-0.810=0.005
max0.922-0.921=0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.839=-0.009
σ0.025-0.032=-0.008
min964.803-964.812=-0.009
max964.863-964.893=-0.030
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.840-0.810=0.030
σ0.015-0.066=-0.050
min0.823-0.699=0.124
max0.852-0.851=0.001
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.009-0.008=0.001
min885.504
max885.524-885.523=0.000
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.706-0.709=-0.004
σ0.019-0.026=-0.008
min0.688-0.675=0.012
max0.731-0.741=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.721=0.002
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean4.253-3.788=0.464
σ0.101-0.360=-0.260
min4.118-3.421=0.697
max4.808-4.483=0.324
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean3.531-4.224=-0.693
σ0.144-0.063=0.081
min3.373-4.113=-0.739
max4.411-4.459=-0.048
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.730-0.750=-0.020
σ0.025-0.019=0.007
min0.693-0.716=-0.024
max0.892-0.862=0.029
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.694-0.711=-0.018
σ0.015-0.018=-0.003
min0.658-0.648=0.011
max0.770-0.799=-0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.635-297.139=-1.504
σ0.256-0.216=0.040
min295.465-296.994=-1.529
max296.340-297.714=-1.374
mean2031.000-2037.000=-6.000
σ0.000
min2031.000-2037.000=-6.000
max2031.000-2037.000=-6.000
mean0.524-0.550=-0.026
σ0.035-0.033=0.001
min0.497-0.506=-0.009
max0.575-0.580=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-286.816=-1.405
σ0.031-0.041=-0.010
min285.370-286.767=-1.398
max285.444-286.860=-1.416
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.403-0.396=0.007
σ0.014-0.006=0.008
min0.383-0.390=-0.006
max0.423-0.404=0.018
iters=5
new-facts=1
prior-facts=6402
mean1295.766-1297.263=-1.497
σ0.117-0.093=0.025
min1295.677-1297.136=-1.458
max1295.961-1297.381=-1.420
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean2.017-2.223=-0.206
σ0.198-0.092=0.106
min1.832-2.119=-0.287
max2.318-2.328=-0.011
iters=5
new-facts=6402
prior-facts=1
mean1540.011-1541.370=-1.360
σ6.904-6.804=0.100
min1536.805-1538.217=-1.412
max1552.359-1553.541=-1.181
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean2.431-2.303=0.128
σ0.342-0.197=0.145
min2.112-2.156=-0.043
max2.865-2.614=0.251
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1859.119=-1.412
σ0.049-0.072=-0.023
min1857.652-1859.031=-1.379
max1857.771-1859.200=-1.428
mean1771.200-1791.400=-20.200
σ176.844-170.754=6.090
min1626.000-1643.000=-17.000
max2031.000-2037.000=-6.000
mean2.859-3.082=-0.224
σ0.122-0.225=-0.103
min2.667-2.844=-0.177
max2.972-3.454=-0.482

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.378-1.249=0.129
σ0.248-0.335=-0.087
min1.116-0.941=0.175
max1.780-1.773=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-448.820=-3.080
σ580.934-581.372=-0.437
min155.271-158.132=-2.861
max1317.141-1320.877=-3.736
mean96.250
σ8.500
min92.000
max109.000
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean0.523-0.562=-0.039
σ0.534-0.600=-0.066
min0.255-0.260=-0.006
max1.324-1.463=-0.139
policies=20
mean1552.985-1581.609=-28.624
σ0.327-0.362=-0.035
min1552.755-1581.367=-28.612
max1553.469-1582.148=-28.678
mean920.000
σ0.000
min920.000
max920.000
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean2.579-2.646=-0.067
σ0.020-0.012=0.008
min2.557-2.635=-0.077
max2.601-2.661=-0.060
policies=200
mean15538.058-15824.166=-286.108
σ0.117-0.094=0.023
min15537.961-15824.047=-286.087
max15538.227-15824.278=-286.051
mean9200.000
σ0.000
min9200.000
max9200.000
mean1626.000-1643.000=-17.000
σ0.000
min1626.000-1643.000=-17.000
max1626.000-1643.000=-17.000
mean26.198-26.718=-0.520
σ0.178-0.082=0.097
min26.022-26.655=-0.634
max26.438-26.838=-0.400