Compare commits

Home / Compare fc5ea1ca .. cf607712

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.002
σ0.371-0.369=0.002
min53.912-53.913=-0.002
max55.110-55.104=0.006
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.141-0.135=0.006
σ0.004-0.004=0.000
min0.137-0.133=0.004
max0.149-0.144=0.005
cache=y
dps=1
iters=10
policies=100
mean43.394-43.396=-0.002
σ0.005-0.007=-0.001
min43.387-43.387=0.000
max43.405-43.407=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.123-0.128=-0.005
σ0.004-0.008=-0.005
min0.119-0.120=-0.001
max0.130-0.142=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.010=-0.008
σ1.199-1.191=0.008
min1006.455-1006.432=0.023
max1012.031-1011.995=0.036
mean1051.900
σ308.767-308.521=0.245
min577.000
max1649.000-1648.000=1.000
mean1.547-1.522=0.025
σ0.075-0.072=0.003
min1.477-1.444=0.033
max1.777-1.698=0.080

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.409-0.422=-0.013
σ0.134-0.135=-0.001
min0.322-0.342=-0.020
max0.645-0.664=-0.019
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.873-0.888=-0.015
σ0.086-0.094=-0.008
min0.823-0.835=-0.012
max1.025-1.053=-0.028
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.530-0.533=-0.003
σ0.053-0.049=0.004
min0.482-0.495=-0.013
max0.617-0.618=-0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.844-0.844=-0.000
σ0.036-0.032=0.004
min0.811-0.816=-0.005
max0.904-0.899=0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.834=0.005
σ0.034-0.024=0.010
min964.809-964.807=0.002
max964.896-964.872=0.024
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.814-0.747=0.067
σ0.051-0.032=0.019
min0.726-0.707=0.019
max0.851-0.781=0.070
name=cdr_enhanced_4k_loc.art
mean885.512-885.517=-0.004
σ0.007-0.006=0.001
min885.505-885.513=-0.007
max885.523-885.528=-0.005
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.729-0.717=0.012
σ0.020-0.026=-0.006
min0.693-0.673=0.020
max0.741-0.736=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean4.273-4.222=0.051
σ0.086-0.088=-0.001
min4.177-4.090=0.086
max4.761-4.522=0.239
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean4.263-4.206=0.058
σ0.069-0.093=-0.024
min4.118-4.072=0.046
max4.551-4.549=0.002
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.742-0.745=-0.003
σ0.020-0.018=0.002
min0.716-0.719=-0.003
max0.894-0.857=0.037
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.705-0.710=-0.005
σ0.018-0.017=0.000
min0.673-0.682=-0.009
max0.804-0.789=0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.083-296.850=0.234
σ0.193-0.223=-0.031
min296.963-296.713=0.249
max297.620-297.456=0.163
mean1920.000-2035.000=-115.000
σ0.000
min1920.000-2035.000=-115.000
max1920.000-2035.000=-115.000
mean0.575-0.560=0.015
σ0.031-0.028=0.003
min0.506-0.514=-0.008
max0.616-0.586=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.825=-0.006
σ0.035-0.035=-0.000
min286.775-286.782=-0.007
max286.855-286.862=-0.007
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.399-0.394=0.005
σ0.008-0.007=0.002
min0.386-0.389=-0.003
max0.408-0.402=0.006
iters=5
new-facts=1
prior-facts=6402
mean1297.230-1297.204=0.026
σ0.063-0.097=-0.034
min1297.151-1297.090=0.060
max1297.290-1297.317=-0.027
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean2.051-1.938=0.113
σ0.053-0.136=-0.082
min1.991-1.794=0.197
max2.132-2.109=0.022
iters=5
new-facts=6402
prior-facts=1
mean1541.325-1541.315=0.010
σ6.831-6.818=0.013
min1538.102-1538.071=0.031
max1553.540-1553.508=0.032
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean2.245-2.213=0.032
σ0.144-0.204=-0.060
min2.134-2.032=0.102
max2.455-2.542=-0.086
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.128=-0.016
σ0.085-0.048=0.037
min1858.996-1859.063=-0.067
max1859.207-1859.189=0.018
mean1777.200-1784.800=-7.600
σ136.480-168.035=-31.555
min1649.000-1648.000=1.000
max1920.000-2035.000=-115.000
mean3.022-2.852=0.170
σ0.119-0.077=0.042
min2.869-2.759=0.111
max3.151-2.972=0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.231-1.181=0.050
σ0.301-0.343=-0.041
min0.934-0.930=0.004
max1.724-1.747=-0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=-0.000
σ581.372-581.372=-0.000
min158.134-158.134=0.000
max1320.879-1320.879=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean0.547-0.553=-0.007
σ0.563-0.580=-0.018
min0.260-0.259=0.001
max1.390-1.423=-0.033
policies=20
mean1581.621-1581.620=0.001
σ0.349-0.352=-0.003
min1581.386-1581.388=-0.001
max1582.140-1582.144=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean2.644-2.632=0.012
σ0.007-0.013=-0.006
min2.634-2.621=0.013
max2.650-2.650=0.001
policies=200
mean15824.158-15824.167=-0.009
σ0.190-0.084=0.106
min15824.008-15824.044=-0.036
max15824.435-15824.224=0.210
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1648.000=1.000
σ0.000
min1649.000-1648.000=1.000
max1649.000-1648.000=1.000
mean26.575-26.473=0.102
σ0.075-0.055=0.020
min26.474-26.435=0.040
max26.653-26.554=0.099