Compare commits

Home / Compare feabd6b2 .. 46b6e2f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.000
σ0.372-0.370=0.002
min53.909-53.912=-0.003
max55.112-55.106=0.006
mean417.000-420.000=-3.000
σ0.000
min417.000-420.000=-3.000
max417.000-420.000=-3.000
mean0.139-0.140=-0.001
σ0.004-0.003=0.002
min0.133-0.138=-0.005
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.001
σ0.007-0.005=0.003
min43.382-43.387=-0.004
max43.409-43.402=0.007
mean417.000-420.000=-3.000
σ0.000
min417.000-420.000=-3.000
max417.000-420.000=-3.000
mean0.121-0.123=-0.002
σ0.004-0.003=0.001
min0.115-0.119=-0.004
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.009-1007.003=0.006
σ1.189-1.209=-0.020
min1006.434-1006.442=-0.008
max1011.988-1012.075=-0.087
mean1052.350-1054.500=-2.150
σ305.975-307.814=-1.839
min577.000-579.000=-2.000
max1650.000-1647.000=3.000
mean1.560-1.547=0.013
σ0.080-0.077=0.003
min1.494-1.459=0.035
max1.795-1.771=0.024

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.423-0.413=0.010
σ0.131-0.138=-0.007
min0.345-0.330=0.015
max0.656-0.656=0.000
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.897-0.884=0.013
σ0.093-0.092=0.001
min0.826-0.830=-0.004
max1.059-1.047=0.013
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.539-0.539=0.001
σ0.050-0.049=0.001
min0.505-0.504=0.002
max0.626-0.625=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.860-0.860=-0.000
σ0.031-0.043=-0.012
min0.843-0.816=0.027
max0.915-0.930=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.037-0.033=0.004
min964.807-964.812=-0.005
max964.900-964.894=0.006
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.810-0.834=-0.024
σ0.050-0.022=0.028
min0.728-0.809=-0.081
max0.851-0.857=-0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.008-0.008=-0.000
min885.504
max885.523-885.523=0.000
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.718-0.681=0.037
σ0.033-0.035=-0.003
min0.665-0.642=0.023
max0.748-0.737=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.721=-0.000
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean4.235-4.245=-0.009
σ0.095-0.079=0.017
min4.069-4.087=-0.018
max4.584-4.611=-0.027
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean4.199-4.243=-0.044
σ0.080-0.096=-0.016
min4.079-4.053=0.026
max4.518-4.574=-0.056
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.746-0.740=0.006
σ0.016-0.018=-0.002
min0.719-0.701=0.018
max0.858-0.850=0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.708-0.700=0.008
σ0.024-0.016=0.008
min0.554-0.670=-0.116
max0.791-0.776=0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.126-297.043=0.083
σ0.173-0.244=-0.071
min297.016-296.888=0.128
max297.599-297.700=-0.101
mean1951.000-1950.000=1.000
σ0.000
min1951.000-1950.000=1.000
max1951.000-1950.000=1.000
mean0.572-0.597=-0.025
σ0.033-0.048=-0.015
min0.506-0.511=-0.005
max0.622-0.705=-0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-286.819=-0.001
σ0.041-0.034=0.007
min286.771-286.775=-0.004
max286.864-286.853=0.011
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.395-0.396=-0.001
σ0.007-0.008=-0.002
min0.388-0.389=-0.001
max0.402-0.408=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.282-1297.284=-0.003
σ0.081-0.079=0.002
min1297.199-1297.198=0.001
max1297.407-1297.403=0.003
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean2.236-2.260=-0.024
σ0.054-0.068=-0.014
min2.157-2.175=-0.018
max2.291-2.332=-0.041
iters=5
new-facts=6402
prior-facts=1
mean1541.349-1541.355=-0.006
σ6.869-6.864=0.005
min1538.104-1538.116=-0.012
max1553.634-1553.630=0.003
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean2.214-2.206=0.008
σ0.099-0.081=0.018
min2.122-2.127=-0.004
max2.383-2.341=0.041
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.119=-0.002
σ0.069-0.068=0.001
min1859.029-1859.037=-0.007
max1859.188-1859.194=-0.006
mean1794.000-1792.400=1.600
σ151.200-152.113=-0.913
min1650.000-1647.000=3.000
max1951.000-1950.000=1.000
mean2.997-2.982=0.015
σ0.163-0.181=-0.018
min2.838-2.776=0.063
max3.239-3.231=0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-1.241=-0.054
σ0.348-0.352=-0.004
min0.938-0.928=0.010
max1.762-1.802=-0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.968-448.967=0.002
σ581.665-581.665=-0.001
min158.135-158.134=0.001
max1321.465-1321.464=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean0.545-0.533=0.012
σ0.562-0.532=0.029
min0.263-0.262=0.001
max1.387-1.332=0.055
policies=20
mean1581.625-1581.634=-0.010
σ0.355-0.371=-0.016
min1581.389-1581.387=0.001
max1582.152-1582.186=-0.034
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean2.645-2.661=-0.016
σ0.004-0.048=-0.044
min2.640-2.623=0.017
max2.649-2.729=-0.080
policies=200
mean15824.233-15824.139=0.094
σ0.137-0.182=-0.046
min15824.139-15824.008=0.131
max15824.432-15824.409=0.023
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1647.000=3.000
σ0.000
min1650.000-1647.000=3.000
max1650.000-1647.000=3.000
mean26.688-26.664=0.024
σ0.128-0.044=0.083
min26.600-26.598=0.002
max26.877-26.692=0.185