Compare commits

Home / Compare 3c35f2a7 .. d618e7c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.002
σ0.369-0.371=-0.002
min53.913-53.908=0.005
max55.105-55.108=-0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.141-0.139=0.002
σ0.004-0.006=-0.003
min0.137-0.130=0.007
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.000
σ0.007-0.006=0.002
min43.385-43.386=-0.001
max43.408-43.401=0.007
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.122-0.123=-0.000
σ0.004-0.004=-0.000
min0.119-0.119=-0.000
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.006=-0.002
σ1.188-1.189=-0.001
min1006.433-1006.434=-0.001
max1011.984-1011.987=-0.003
mean1049.600-1055.100=-5.500
σ308.793-314.791=-5.998
min574.000-585.000=-11.000
max1646.000-1618.000=28.000
mean1.520-1.530=-0.010
σ0.085-0.053=0.032
min1.341-1.459=-0.118
max1.755-1.631=0.124

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.421-0.447=-0.027
σ0.139-0.147=-0.008
min0.339-0.362=-0.024
max0.667-0.705=-0.038
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.884-0.940=-0.056
σ0.091-0.214=-0.123
min0.820-0.827=-0.007
max1.042-1.322=-0.281
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.534-0.554=-0.020
σ0.044-0.057=-0.013
min0.494-0.487=0.007
max0.604-0.615=-0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.849-0.868=-0.019
σ0.048-0.039=0.010
min0.811-0.843=-0.032
max0.931-0.936=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.000
σ0.028-0.035=-0.006
min964.819-964.810=0.009
max964.886-964.898=-0.012
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.831-0.810=0.021
σ0.036-0.060=-0.025
min0.776-0.727=0.049
max0.864-0.861=0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.000
σ0.007-0.008=-0.000
min885.505-885.506=-0.000
max885.522-885.525=-0.003
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.727-0.696=0.031
σ0.022-0.039=-0.017
min0.694-0.648=0.046
max0.747-0.751=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.001
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean3.551-4.281=-0.730
σ0.079-0.080=-0.001
min3.321-4.132=-0.811
max3.822-4.671=-0.849
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean3.523-4.262=-0.739
σ0.075-0.117=-0.042
min3.355-4.096=-0.741
max3.771-5.012=-1.241
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.752-0.750=0.003
σ0.021-0.017=0.004
min0.712-0.711=0.001
max0.862-0.863=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.707-0.703=0.003
σ0.015-0.015=0.000
min0.676-0.674=0.003
max0.786-0.780=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.928-296.935=-0.008
σ0.205-0.246=-0.042
min296.726-296.719=0.007
max297.472-297.559=-0.087
mean1930.000-2032.000=-102.000
σ0.000
min1930.000-2032.000=-102.000
max1930.000-2032.000=-102.000
mean0.592-0.577=0.015
σ0.048-0.020=0.027
min0.506-0.537=-0.032
max0.691-0.595=0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.818=0.002
σ0.040-0.039=0.002
min286.764-286.767=-0.003
max286.861-286.858=0.003
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.400-0.396=0.004
σ0.007-0.005=0.001
min0.389-0.388=0.001
max0.407-0.400=0.007
iters=5
new-facts=1
prior-facts=6402
mean1297.254-1297.211=0.043
σ0.080-0.121=-0.041
min1297.168-1297.088=0.080
max1297.343-1297.363=-0.020
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean2.103-1.879=0.224
σ0.078-0.094=-0.016
min2.014-1.804=0.210
max2.207-2.017=0.191
iters=5
new-facts=6402
prior-facts=1
mean1541.309-1541.335=-0.027
σ6.838-6.843=-0.005
min1538.049-1538.054=-0.004
max1553.536-1553.573=-0.036
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean2.177-2.230=-0.053
σ0.085-0.156=-0.071
min2.121-2.119=0.002
max2.327-2.489=-0.162
iters=5
new-facts=6402
prior-facts=6402
mean1859.122-1859.123=-0.001
σ0.064-0.065=-0.001
min1859.040-1859.032=0.008
max1859.192-1859.199=-0.007
mean1781.400-1763.000=18.400
σ142.765-178.827=-36.062
min1646.000-1618.000=28.000
max1930.000-2032.000=-102.000
mean3.001-2.891=0.110
σ0.074-0.145=-0.072
min2.883-2.777=0.106
max3.086-3.143=-0.057

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.178-1.228=-0.050
σ0.319-0.363=-0.044
min0.942-0.932=0.010
max1.702-1.843=-0.141

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.000
min158.134-158.131=0.004
max1320.880-1320.880=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean0.550-0.533=0.018
σ0.565-0.538=0.027
min0.263-0.260=0.003
max1.397-1.339=0.058
policies=20
mean1581.613-1581.621=-0.008
σ0.352-0.340=0.012
min1581.389-1581.390=-0.000
max1582.138-1582.126=0.013
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean2.641-2.608=0.033
σ0.012-0.014=-0.001
min2.632-2.591=0.042
max2.659-2.623=0.036
policies=200
mean15824.177-15824.268=-0.091
σ0.156-0.067=0.090
min15824.031-15824.218=-0.187
max15824.394-15824.366=0.028
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1618.000=28.000
σ0.000
min1646.000-1618.000=28.000
max1646.000-1618.000=28.000
mean26.646-26.573=0.074
σ0.044-0.048=-0.004
min26.598-26.517=0.081
max26.705-26.630=0.075