Compare commits

Home / Compare 319f2316 .. 91f5b542

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.057=-0.002
σ0.368-0.370=-0.001
min53.910-53.913=-0.003
max55.103-55.109=-0.006
mean413.500-418.000=-4.500
σ0.527-0.000=0.527
min413.000-418.000=-5.000
max414.000-418.000=-4.000
mean0.137-0.139=-0.001
σ0.004-0.004=0.000
min0.131-0.136=-0.004
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.002
σ0.006-0.006=-0.001
min43.388-43.386=0.002
max43.402-43.406=-0.004
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.123-0.121=0.001
σ0.003-0.003=0.000
min0.120-0.118=0.002
max0.128-0.126=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.954=0.024
σ0.871-0.894=-0.024
min1006.482-1006.488=-0.007
max1010.581-1010.677=-0.096
mean1047.650-1050.300=-2.650
σ307.736-317.453=-9.717
min553.000-548.000=5.000
max1642.000-1651.000=-9.000
mean1.546-1.547=-0.001
σ0.072-0.095=-0.023
min1.481-1.468=0.013
max1.753-1.782=-0.029

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.421-0.426=-0.005
σ0.138-0.132=0.006
min0.336-0.354=-0.018
max0.666-0.660=0.006
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.882-0.890=-0.008
σ0.089-0.096=-0.007
min0.814-0.836=-0.021
max1.034-1.061=-0.027
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.544-0.541=0.004
σ0.043-0.035=0.008
min0.508-0.513=-0.005
max0.615-0.598=0.017
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.837-0.848=-0.011
σ0.038-0.038=0.000
min0.800-0.815=-0.016
max0.895-0.912=-0.017

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.838=-0.003
σ0.031-0.032=-0.001
min964.807-964.809=-0.002
max964.888-964.891=-0.002
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.832-0.848=-0.016
σ0.048-0.008=0.041
min0.750-0.837=-0.088
max0.872-0.857=0.015
name=cdr_enhanced_4k_loc.art
mean885.515-885.512=0.003
σ0.005-0.007=-0.003
min885.508-885.504=0.004
max885.519-885.522=-0.004
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.698-0.726=-0.029
σ0.042-0.035=0.007
min0.643-0.665=-0.022
max0.734-0.747=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.000
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean3.498-4.222=-0.724
σ0.090-0.080=0.009
min3.326-4.026=-0.699
max4.069-4.511=-0.442
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean3.477-4.208=-0.731
σ0.080-0.080=0.000
min3.365-4.031=-0.666
max3.762-4.452=-0.689
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.744-0.748=-0.004
σ0.027-0.034=-0.007
min0.570-0.541=0.028
max0.856-0.943=-0.087
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.581-0.707=-0.125
σ0.099-0.014=0.085
min0.487-0.674=-0.187
max0.788-0.788=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.380-295.597=-0.217
σ0.165-0.222=-0.057
min295.277-295.436=-0.159
max295.832-296.211=-0.379
mean1906.000-1908.000=-2.000
σ0.000
min1906.000-1908.000=-2.000
max1906.000-1908.000=-2.000
mean0.574-0.580=-0.006
σ0.041-0.038=0.003
min0.493-0.503=-0.010
max0.627-0.618=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.399=0.014
σ0.037-0.036=0.001
min285.368-285.355=0.013
max285.453-285.441=0.012
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.387-0.391=-0.005
σ0.007-0.008=-0.000
min0.380-0.381=-0.001
max0.396-0.400=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.775=0.019
σ0.114-0.107=0.007
min1295.663-1295.659=0.004
max1295.936-1295.898=0.038
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean1.988-1.898=0.089
σ0.276-0.079=0.196
min1.797-1.814=-0.017
max2.467-1.981=0.486
iters=5
new-facts=6402
prior-facts=1
mean1539.974-1539.945=0.029
σ6.833-6.857=-0.024
min1536.707-1536.651=0.057
max1552.192-1552.206=-0.014
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean2.403-2.385=0.017
σ0.238-0.219=0.019
min2.052-2.056=-0.004
max2.635-2.605=0.030
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.684=0.022
σ0.056-0.068=-0.012
min1857.654-1857.596=0.057
max1857.784-1857.771=0.013
mean1774.200-1778.800=-4.600
σ130.550-127.796=2.754
min1642.000-1651.000=-9.000
max1906.000-1908.000=-2.000
mean3.056-3.022=0.035
σ0.272-0.175=0.097
min2.842-2.869=-0.027
max3.525-3.311=0.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.306-1.183=0.123
σ0.279-0.350=-0.072
min1.098-0.937=0.161
max1.779-1.776=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.742-445.707=0.036
σ580.937-580.934=0.002
min155.270-155.236=0.035
max1317.147-1317.108=0.039
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean0.544-0.520=0.024
σ0.561-0.513=0.047
min0.262-0.259=0.002
max1.385-1.289=0.095
policies=20
mean1552.990-1552.667=0.322
σ0.325-0.344=-0.019
min1552.768-1552.434=0.333
max1553.472-1553.179=0.293
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean2.586-2.611=-0.025
σ0.009-0.012=-0.003
min2.575-2.596=-0.021
max2.594-2.626=-0.032
policies=200
mean15537.740-15534.621=3.120
σ0.469-0.143=0.326
min15537.052-15534.518=2.534
max15538.071-15534.832=3.239
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1651.000=-9.000
σ0.000
min1642.000-1651.000=-9.000
max1642.000-1651.000=-9.000
mean26.183-26.296=-0.113
σ0.213-0.104=0.109
min26.024-26.141=-0.117
max26.497-26.364=0.133