Compare commits

Home / Compare 01d544c8 .. ea4813b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.053=0.002
σ0.368-0.371=-0.002
min53.910-53.905=0.005
max55.103-55.108=-0.005
mean413.500-415.000=-1.500
σ0.527-0.000=0.527
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.137-0.138=-0.000
σ0.004-0.005=-0.001
min0.131-0.130=0.002
max0.142-0.146=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.394-43.399=-0.005
σ0.006-0.007=-0.002
min43.388-43.390=-0.002
max43.402-43.415=-0.013
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.123-0.142=-0.019
σ0.003-0.004=-0.001
min0.120-0.135=-0.015
max0.128-0.150=-0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1007.005=-0.027
σ0.871-1.203=-0.333
min1006.482-1006.432=0.050
max1010.581-1012.051=-1.470
mean1047.650-1052.500=-4.850
σ307.736-307.895=-0.159
min553.000-577.000=-24.000
max1642.000-1644.000=-2.000
mean1.546-1.539=0.006
σ0.072-0.076=-0.004
min1.481-1.461=0.020
max1.753-1.766=-0.012

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.421-0.420=0.002
σ0.138-0.126=0.012
min0.336-0.350=-0.014
max0.666-0.644=0.022
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.882-0.880=0.002
σ0.089-0.089=-0.001
min0.814-0.819=-0.005
max1.034-1.038=-0.004
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.544-0.539=0.005
σ0.043-0.057=-0.014
min0.508-0.503=0.005
max0.615-0.640=-0.025
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.837-0.838=-0.001
σ0.038-0.040=-0.001
min0.800-0.811=-0.011
max0.895-0.907=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.839=-0.003
σ0.031-0.032=-0.001
min964.807-964.811=-0.004
max964.888-964.894=-0.006
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.832-0.832=0.000
σ0.048-0.018=0.031
min0.750-0.809=-0.059
max0.872-0.847=0.024
name=cdr_enhanced_4k_loc.art
mean885.515-885.512=0.002
σ0.005-0.007=-0.003
min885.508-885.504=0.004
max885.519-885.522=-0.004
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.698-0.703=-0.005
σ0.042-0.046=-0.005
min0.643-0.625=0.018
max0.734-0.735=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.000
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean3.498-4.252=-0.753
σ0.090-0.092=-0.002
min3.326-4.128=-0.802
max4.069-4.655=-0.586
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean3.477-4.222=-0.745
σ0.080-0.061=0.019
min3.365-4.115=-0.750
max3.762-4.441=-0.679
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.744-0.751=-0.007
σ0.027-0.022=0.006
min0.570-0.706=-0.137
max0.856-0.878=-0.022
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.581-0.708=-0.127
σ0.099-0.015=0.083
min0.487-0.675=-0.188
max0.788-0.786=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.380-297.110=-1.730
σ0.165-0.205=-0.040
min295.277-296.965=-1.688
max295.832-297.669=-1.837
mean1906.000-2033.000=-127.000
σ0.000
min1906.000-2033.000=-127.000
max1906.000-2033.000=-127.000
mean0.574-0.559=0.015
σ0.041-0.034=0.007
min0.493-0.506=-0.012
max0.627-0.591=0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-286.827=-1.414
σ0.037-0.040=-0.003
min285.368-286.773=-1.405
max285.453-286.866=-1.413
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.387-0.396=-0.009
σ0.007-0.006=0.001
min0.380-0.389=-0.009
max0.396-0.402=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1297.239=-1.444
σ0.114-0.058=0.056
min1295.663-1297.169=-1.506
max1295.936-1297.300=-1.364
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean1.988-2.062=-0.075
σ0.276-0.090=0.186
min1.797-1.958=-0.161
max2.467-2.181=0.287
iters=5
new-facts=6402
prior-facts=1
mean1539.974-1541.325=-1.351
σ6.833-6.829=0.004
min1536.707-1538.099=-1.392
max1552.192-1553.537=-1.344
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean2.403-2.230=0.173
σ0.238-0.177=0.061
min2.052-2.054=-0.002
max2.635-2.505=0.130
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1859.124=-1.418
σ0.056-0.059=-0.003
min1857.654-1859.045=-1.391
max1857.784-1859.194=-1.409
mean1774.200-1782.200=-8.000
σ130.550-168.752=-38.202
min1642.000-1644.000=-2.000
max1906.000-2033.000=-127.000
mean3.056-2.908=0.148
σ0.272-0.097=0.175
min2.842-2.803=0.038
max3.525-3.047=0.478

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.306-1.277=0.029
σ0.279-0.356=-0.077
min1.098-0.939=0.159
max1.779-1.756=0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.742-448.819=-3.076
σ580.937-581.373=-0.437
min155.270-158.129=-2.859
max1317.147-1320.879=-3.731
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean0.544-0.532=0.012
σ0.561-0.537=0.024
min0.262-0.263=-0.001
max1.385-1.337=0.048
policies=20
mean1552.990-1581.598=-28.608
σ0.325-0.349=-0.024
min1552.768-1581.369=-28.602
max1553.472-1582.117=-28.645
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean2.586-2.626=-0.040
σ0.009-0.012=-0.003
min2.575-2.616=-0.040
max2.594-2.642=-0.048
policies=200
mean15537.740-15824.090=-286.349
σ0.469-0.092=0.378
min15537.052-15824.006=-286.954
max15538.071-15824.220=-286.149
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1644.000=-2.000
σ0.000
min1642.000-1644.000=-2.000
max1642.000-1644.000=-2.000
mean26.183-26.609=-0.426
σ0.213-0.051=0.162
min26.024-26.559=-0.535
max26.497-26.675=-0.178