Compare commits

Home / Compare 97e15224 .. c41557af

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.370-0.367=0.002
min53.911-53.913=-0.002
max55.106-55.100=0.007
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.141-0.141=0.000
σ0.006-0.004=0.002
min0.135-0.137=-0.002
max0.150-0.148=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.005=0.001
min43.387-43.387=-0.000
max43.404-43.403=0.001
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.121-0.122=-0.001
σ0.005-0.004=0.001
min0.115-0.119=-0.003
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.005=-0.001
σ1.202-1.187=0.015
min1006.435-1006.433=0.002
max1012.048-1011.981=0.067
mean1055.700-1055.100=0.600
σ308.526-307.803=0.723
min581.000-580.000=1.000
max1654.000-1647.000=7.000
mean1.553-1.531=0.022
σ0.083-0.085=-0.002
min1.481-1.393=0.089
max1.791-1.786=0.005

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.411-0.412=-0.000
σ0.137-0.129=0.008
min0.318-0.339=-0.021
max0.652-0.640=0.012
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.873-0.893=-0.020
σ0.082-0.091=-0.009
min0.820-0.835=-0.016
max1.017-1.052=-0.036
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.527-0.533=-0.005
σ0.047-0.048=-0.001
min0.491-0.496=-0.005
max0.601-0.612=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.832-0.842=-0.010
σ0.044-0.035=0.009
min0.803-0.823=-0.020
max0.910-0.904=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.838=0.001
σ0.028-0.034=-0.005
min964.819-964.811=0.007
max964.885-964.895=-0.010
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.818-0.824=-0.005
σ0.033-0.029=0.004
min0.780-0.779=0.000
max0.858-0.853=0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.008-0.004=0.003
min885.504
max885.523-885.516=0.008
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.701-0.714=-0.014
σ0.029-0.037=-0.008
min0.653-0.653=-0.000
max0.733-0.741=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.002
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean4.221-3.480=0.741
σ0.101-0.089=0.012
min4.081-3.336=0.746
max4.604-3.791=0.813
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean3.686-3.480=0.206
σ0.270-0.069=0.201
min3.362-3.370=-0.008
max4.434-3.734=0.700
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.736-0.735=0.000
σ0.033-0.019=0.014
min0.550-0.652=-0.102
max0.918-0.841=0.076
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.554-0.693=-0.139
σ0.079-0.015=0.064
min0.491-0.661=-0.170
max0.792-0.778=0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.159-297.079=0.080
σ0.192-0.228=-0.036
min297.033-296.918=0.116
max297.660-297.713=-0.053
mean2033.000-2035.000=-2.000
σ0.000
min2033.000-2035.000=-2.000
max2033.000-2035.000=-2.000
mean0.540-0.556=-0.016
σ0.034-0.034=-0.001
min0.503-0.504=-0.001
max0.587-0.602=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.798-286.825=-0.027
σ0.036-0.038=-0.002
min286.749-286.773=-0.024
max286.833-286.864=-0.031
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.395-0.397=-0.002
σ0.007-0.008=-0.000
min0.390-0.389=0.001
max0.408-0.407=0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.260-1297.267=-0.006
σ0.082-0.063=0.019
min1297.157-1297.192=-0.035
max1297.363-1297.352=0.011
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean2.104-2.091=0.014
σ0.089-0.073=0.016
min2.010-2.020=-0.010
max2.228-2.191=0.037
iters=5
new-facts=6402
prior-facts=1
mean1541.310-1541.312=-0.002
σ6.843-6.841=0.002
min1538.055-1538.067=-0.013
max1553.547-1553.545=0.002
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean2.199-2.190=0.009
σ0.117-0.105=0.013
min2.097-2.098=-0.002
max2.391-2.353=0.038
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.113=0.001
σ0.081-0.074=0.007
min1858.987-1858.996=-0.009
max1859.186-1859.181=0.005
mean1786.000-1784.200=1.800
σ164.804-168.307=-3.502
min1654.000-1647.000=7.000
max2033.000-2035.000=-2.000
mean2.946-2.949=-0.002
σ0.082-0.073=0.010
min2.852-2.846=0.006
max3.067-3.041=0.026

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.269=-0.089
σ0.324-0.295=0.029
min0.966-1.064=-0.097
max1.755-1.778=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=-0.000
σ581.372-581.372=0.000
min158.131-158.134=-0.003
max1320.879-1320.879=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean0.525-0.558=-0.033
σ0.513-0.585=-0.072
min0.266-0.263=0.003
max1.295-1.436=-0.141
policies=20
mean1581.632-1581.628=0.004
σ0.361-0.357=0.004
min1581.391-1581.388=0.004
max1582.170-1582.160=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean2.637-2.640=-0.003
σ0.014-0.011=0.003
min2.622-2.629=-0.007
max2.654-2.655=-0.000
policies=200
mean15824.232-15824.146=0.085
σ0.117-0.188=-0.071
min15824.145-15823.991=0.154
max15824.396-15824.420=-0.024
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1647.000=7.000
σ0.000
min1654.000-1647.000=7.000
max1654.000-1647.000=7.000
mean26.627-26.608=0.019
σ0.050-0.052=-0.002
min26.582-26.534=0.048
max26.694-26.654=0.040