Compare commits

Home / Compare e06bb75a .. b02f3237

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.042-54.042=0.000
σ0.368-0.366=0.002
min53.899-53.898=0.001
max55.091-55.084=0.007
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.138-0.138=-0.000
σ0.005-0.005=-0.000
min0.133-0.131=0.002
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.006=0.001
min43.382-43.384=-0.002
max43.402-43.400=0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.122-0.120=0.002
σ0.004-0.004=-0.000
min0.115-0.114=0.000
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.338-1006.331=0.008
σ0.875-0.890=-0.015
min1005.833-1005.833=-0.000
max1009.947-1010.019=-0.072
mean1050.800-1046.600=4.200
σ309.746-307.672=2.073
min556.000-571.000=-15.000
max1645.000-1647.000=-2.000
mean1.564-1.555=0.009
σ0.104-0.077=0.027
min1.475-1.470=0.005
max1.823-1.773=0.050

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.404-0.421=-0.017
σ0.108-0.136=-0.028
min0.340-0.345=-0.006
max0.595-0.661=-0.066
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.890-0.883=0.007
σ0.092-0.096=-0.004
min0.835-0.811=0.024
max1.052-1.048=0.004
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.552-0.545=0.007
σ0.049-0.056=-0.007
min0.507-0.495=0.012
max0.634-0.638=-0.004
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.851-0.851=-0.001
σ0.039-0.045=-0.006
min0.806-0.810=-0.004
max0.909-0.929=-0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.557=-0.006
σ0.025-0.031=-0.006
min963.523-963.532=-0.009
max963.584-963.609=-0.025
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.805-0.808=-0.003
σ0.041-0.062=-0.022
min0.742-0.705=0.037
max0.852-0.872=-0.020
name=cdr_enhanced_4k_loc.art
mean884.857-884.856=0.001
σ0.004-0.006=-0.002
min884.851-884.847=0.004
max884.861-884.861=0.001
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.711-0.721=-0.010
σ0.061-0.020=0.041
min0.602-0.703=-0.101
max0.741-0.753=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.001
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean3.533-4.280=-0.747
σ0.074-0.110=-0.036
min3.378-4.117=-0.739
max3.822-4.626=-0.804
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.658
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean3.522-4.257=-0.735
σ0.072-0.078=-0.007
min3.421-4.107=-0.687
max3.769-4.597=-0.828
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.538-0.752=-0.214
σ0.014-0.016=-0.003
min0.514-0.727=-0.213
max0.612-0.866=-0.255
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.513-0.718=-0.205
σ0.011-0.017=-0.007
min0.489-0.678=-0.189
max0.558-0.796=-0.238

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.658-295.697=-0.039
σ0.206-0.197=0.009
min295.485-295.420=0.065
max296.198-296.168=0.029
mean1892.000-1893.000=-1.000
σ0.000
min1892.000-1893.000=-1.000
max1892.000-1893.000=-1.000
mean0.575-0.591=-0.016
σ0.044-0.052=-0.007
min0.501-0.499=0.002
max0.663-0.702=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.249-285.251=-0.002
σ0.038-0.037=0.002
min285.203-285.209=-0.006
max285.294-285.293=0.001
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.397-0.396=0.001
σ0.009-0.012=-0.002
min0.388-0.386=0.001
max0.409-0.412=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.199-1295.198=0.001
σ0.114-0.110=0.004
min1295.082-1295.079=0.003
max1295.348-1295.330=0.018
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean1.925-1.920=0.005
σ0.108-0.108=-0.001
min1.801-1.803=-0.001
max2.039-2.024=0.015
iters=5
new-facts=6402
prior-facts=1
mean1539.436-1539.364=0.072
σ6.835-6.883=-0.048
min1536.197-1536.081=0.116
max1551.660-1551.672=-0.012
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.405-2.262=0.144
σ0.326-0.135=0.192
min2.068-2.108=-0.040
max2.872-2.442=0.429
iters=5
new-facts=6402
prior-facts=6402
mean1857.109-1857.107=0.002
σ0.059-0.055=0.004
min1857.050-1857.051=-0.001
max1857.193-1857.179=0.014
mean1772.800-1765.400=7.400
σ120.610-121.593=-0.983
min1645.000-1647.000=-2.000
max1892.000-1893.000=-1.000
mean3.022-3.063=-0.042
σ0.275-0.234=0.041
min2.691-2.846=-0.155
max3.438-3.447=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.382-1.318=0.064
σ0.237-0.291=-0.054
min1.258-1.111=0.146
max1.805-1.818=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.289-445.291=-0.002
σ580.424-580.424=0.000
min155.075-155.077=-0.002
max1315.925-1315.926=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean0.557-0.542=0.015
σ0.589-0.556=0.034
min0.261-0.263=-0.002
max1.441-1.375=0.066
policies=20
mean1551.040-1551.045=-0.005
σ0.333-0.330=0.003
min1550.809-1550.820=-0.011
max1551.534-1551.535=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean2.591-2.588=0.003
σ0.020-0.012=0.007
min2.575-2.577=-0.003
max2.617-2.606=0.011
policies=200
mean15518.464-15518.452=0.012
σ0.066-0.086=-0.020
min15518.388-15518.332=0.056
max15518.521-15518.520=0.001
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1647.000=-2.000
σ0.000
min1645.000-1647.000=-2.000
max1645.000-1647.000=-2.000
mean26.188-26.194=-0.005
σ0.085-0.180=-0.094
min26.131-26.082=0.049
max26.315-26.462=-0.147