Compare commits

Home / Compare 2e936d30 .. 09b5cddc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.704=-0.001
σ0.368-0.369=-0.001
min53.556-53.559=-0.004
max54.751-54.754=-0.004
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.138-0.140=-0.002
σ0.005-0.005=-0.000
min0.129-0.136=-0.006
max0.144-0.148=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.058-43.060=-0.002
σ0.006-0.007=-0.001
min43.049-43.050=-0.001
max43.066-43.069=-0.003
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.122-0.122=-0.001
σ0.003-0.004=-0.001
min0.118-0.119=-0.000
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.108-1005.106=0.002
σ0.875-0.895=-0.020
min1004.620-1004.635=-0.015
max1008.735-1008.821=-0.086
mean1052.950-1056.900=-3.950
σ321.163-309.527=11.636
min552.000-568.000=-16.000
max1632.000-1651.000=-19.000
mean1.621-1.612=0.009
σ0.088-0.061=0.027
min1.478-1.526=-0.048
max1.860-1.726=0.134

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.498-0.420=0.078
σ0.187-0.138=0.049
min0.353-0.338=0.015
max0.712-0.664=0.048
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.912-0.901=0.012
σ0.110-0.097=0.014
min0.839-0.843=-0.004
max1.108-1.072=0.035
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.553-0.548=0.005
σ0.052-0.047=0.006
min0.514-0.512=0.001
max0.644-0.624=0.021
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.891-0.878=0.013
σ0.054-0.055=-0.000
min0.831-0.821=0.009
max0.973-0.954=0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.551=0.002
σ0.035-0.027=0.008
min963.533-963.523=0.011
max963.615-963.593=0.022
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.826-0.828=-0.002
σ0.051-0.035=0.017
min0.761-0.784=-0.023
max0.865-0.856=0.009
name=cdr_enhanced_4k_loc.art
mean884.853-884.856=-0.003
σ0.008-0.005=0.003
min884.847
max884.867-884.860=0.006
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.736-0.717=0.019
σ0.034-0.018=0.016
min0.675-0.696=-0.020
max0.758-0.738=0.020

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.712=-0.001
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean4.285-3.529=0.755
σ0.072-0.075=-0.003
min4.146-3.397=0.749
max4.603-3.807=0.797
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean4.248-3.553=0.695
σ0.087-0.083=0.004
min4.101-3.388=0.713
max4.639-3.909=0.731
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.766-0.534=0.232
σ0.022-0.014=0.008
min0.737-0.512=0.226
max0.928-0.616=0.312
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.723-0.509=0.215
σ0.017-0.011=0.006
min0.681-0.486=0.195
max0.796-0.561=0.234

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.181-294.489=-0.307
σ0.187-0.239=-0.052
min293.987-294.222=-0.235
max294.669-295.071=-0.401
mean1939.000-1903.000=36.000
σ0.000
min1939.000-1903.000=36.000
max1939.000-1903.000=36.000
mean0.563-0.568=-0.004
σ0.052-0.033=0.019
min0.487-0.517=-0.030
max0.661-0.610=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.497=-0.001
σ0.040-0.036=0.005
min281.448-281.454=-0.006
max281.539-281.534=0.006
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.394-0.393=0.001
σ0.006-0.006=-0.000
min0.386-0.385=0.001
max0.400-0.401=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1291.476-1291.481=-0.005
σ0.103-0.111=-0.008
min1291.360-1291.355=0.005
max1291.612-1291.620=-0.008
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean1.982-1.886=0.096
σ0.160-0.100=0.061
min1.839-1.789=0.050
max2.249-2.036=0.213
iters=5
new-facts=6402
prior-facts=1
mean1534.321-1534.372=-0.051
σ4.013-3.975=0.038
min1532.297-1532.365=-0.068
max1541.491-1541.474=0.018
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean2.222-2.358=-0.136
σ0.190-0.230=-0.040
min2.036-2.028=0.007
max2.462-2.618=-0.155
iters=5
new-facts=6402
prior-facts=6402
mean1853.354-1853.354=0.000
σ0.049-0.052=-0.002
min1853.307-1853.312=-0.004
max1853.423-1853.430=-0.006
mean1792.800-1774.600=18.200
σ147.298-122.967=24.331
min1632.000-1651.000=-19.000
max1939.000-1903.000=36.000
mean3.137-3.063=0.073
σ0.281-0.281=-0.000
min2.905-2.870=0.036
max3.622-3.557=0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.487-1.400=0.087
σ0.289-0.271=0.018
min1.122-1.116=0.006
max1.889-1.812=0.077

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.430-442.429=0.000
σ577.064-577.064=0.000
min153.896-153.895=0.001
max1308.026-1308.026=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean0.552-0.546=0.006
σ0.590-0.578=0.012
min0.255-0.257=-0.001
max1.436-1.412=0.024
policies=20
mean1539.224-1539.221=0.003
σ0.316-0.313=0.003
min1539.004-1539.003=0.002
max1539.693-1539.685=0.008
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean2.571-2.565=0.006
σ0.010-0.018=-0.008
min2.560-2.546=0.014
max2.581-2.589=-0.008
policies=200
mean15400.412-15400.360=0.053
σ0.053-0.115=-0.062
min15400.358-15400.237=0.121
max15400.484-15400.468=0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1651.000=-19.000
σ0.000
min1632.000-1651.000=-19.000
max1632.000-1651.000=-19.000
mean26.049-26.043=0.006
σ0.047-0.154=-0.107
min25.991-25.878=0.113
max26.102-26.247=-0.145