Compare commits

Home / Compare 219b8d30 .. 1f351c39

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.963=0.001
σ0.371-0.369=0.002
min53.821-53.819=0.003
max55.019-55.012=0.007
mean419.000-415.700=3.300
σ0.000-0.483=-0.483
min419.000-415.000=4.000
max419.000-416.000=3.000
mean0.138-0.139=-0.000
σ0.007-0.003=0.004
min0.130-0.135=-0.006
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.006-0.007=-0.000
min43.313-43.310=0.003
max43.338-43.335=0.003
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.123-0.120=0.003
σ0.005-0.004=0.001
min0.118-0.114=0.004
max0.131-0.125=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.511-1006.519=-0.007
σ1.182-1.151=0.032
min1005.955-1005.950=0.005
max1011.457-1011.330=0.127
mean1048.900-1051.000=-2.100
σ314.997-315.136=-0.139
min551.000-580.000=-29.000
max1529.000-1650.000=-121.000
mean1.531-1.557=-0.025
σ0.079-0.102=-0.023
min1.452-1.448=0.004
max1.731-1.815=-0.084

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.414-0.444=-0.030
σ0.138-0.183=-0.044
min0.325-0.346=-0.021
max0.657-0.768=-0.111
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.344-2.342=0.001
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.895-0.928=-0.033
σ0.086-0.189=-0.104
min0.836-0.813=0.023
max1.046-1.263=-0.218
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.537-0.542=-0.006
σ0.056-0.072=-0.016
min0.492-0.486=0.006
max0.632-0.662=-0.029
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.858-0.837=0.021
σ0.041-0.029=0.013
min0.823-0.810=0.014
max0.930-0.882=0.048

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.821-964.837=-0.016
σ0.024-0.019=0.005
min964.802-964.821=-0.019
max964.860-964.870=-0.009
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.809-0.794=0.015
σ0.086-0.057=0.029
min0.658-0.722=-0.064
max0.862-0.864=-0.001
name=cdr_enhanced_4k_loc.art
mean885.510-885.514=-0.004
σ0.005-0.001=0.004
min885.504-885.512=-0.008
max885.516-885.515=0.001
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.703-0.670=0.033
σ0.039-0.068=-0.029
min0.668-0.567=0.100
max0.748-0.733=0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean4.214-3.492=0.722
σ0.081-0.086=-0.006
min4.096-3.340=0.756
max4.495-3.949=0.546
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean4.202-3.497=0.705
σ0.070-0.078=-0.008
min4.083-3.333=0.750
max4.473-3.776=0.696
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.749-0.742=0.007
σ0.018-0.019=-0.001
min0.719-0.709=0.011
max0.851-0.834=0.017
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.707-0.703=0.005
σ0.016-0.016=-0.001
min0.678-0.664=0.014
max0.775-0.770=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.325-296.366=-0.041
σ0.181-0.240=-0.058
min296.175-296.190=-0.015
max296.801-297.024=-0.223
mean1889.000-1899.000=-10.000
σ0.000
min1889.000-1899.000=-10.000
max1889.000-1899.000=-10.000
mean0.585-0.587=-0.002
σ0.033-0.047=-0.014
min0.535-0.516=0.019
max0.653-0.700=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-285.024=0.008
σ0.037-0.035=0.002
min284.982-284.979=0.003
max285.072-285.067=0.005
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.395-0.391=0.003
σ0.006-0.008=-0.002
min0.388-0.386=0.002
max0.401-0.403=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.417-1295.387=0.031
σ0.114-0.111=0.003
min1295.299-1295.289=0.010
max1295.581-1295.572=0.010
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean1.888-2.006=-0.118
σ0.083-0.194=-0.111
min1.814-1.761=0.053
max1.979-2.170=-0.191
iters=5
new-facts=6402
prior-facts=1
mean1539.520-1539.605=-0.085
σ6.856-6.790=0.066
min1536.226-1536.464=-0.238
max1551.780-1551.749=0.030
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean2.233-2.394=-0.161
σ0.212-0.233=-0.021
min2.037-2.169=-0.132
max2.510-2.750=-0.240
iters=5
new-facts=6402
prior-facts=6402
mean1857.322-1857.324=-0.002
σ0.071-0.056=0.015
min1857.239-1857.275=-0.036
max1857.418-1857.411=0.008
mean1752.000-1770.800=-18.800
σ155.634-122.494=33.141
min1529.000-1650.000=-121.000
max1889.000-1899.000=-10.000
mean2.941-2.990=-0.050
σ0.171-0.236=-0.065
min2.664-2.691=-0.028
max3.099-3.354=-0.254

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.705-1.164=0.541
σ0.182-0.322=-0.140
min1.476-0.928=0.549
max1.869-1.686=0.183

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.190=0.001
σ581.331-581.332=-0.001
min157.525-157.521=0.003
max1320.187-1320.188=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean0.542-0.553=-0.011
σ0.565-0.571=-0.006
min0.259-0.266=-0.008
max1.389-1.409=-0.020
policies=20
mean1575.568-1575.573=-0.005
σ0.348-0.357=-0.009
min1575.332-1575.333=-0.001
max1576.085-1576.103=-0.018
mean920.000
σ0.000
min920.000
max920.000
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean2.622-2.630=-0.008
σ0.016-0.016=-0.000
min2.608-2.615=-0.007
max2.645-2.647=-0.003
policies=200
mean15763.760-15763.767=-0.006
σ0.108-0.138=-0.030
min15763.699-15763.669=0.029
max15763.921-15763.969=-0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1529.000-1650.000=-121.000
σ0.000
min1529.000-1650.000=-121.000
max1529.000-1650.000=-121.000
mean26.489-26.534=-0.045
σ0.031-0.135=-0.104
min26.461-26.456=0.005
max26.532-26.736=-0.203