Compare commits

Home / Compare 7528479c .. ba3ac69d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.057=-0.000
σ0.369-0.369=0.000
min53.909-53.912=-0.003
max55.108-55.107=0.000
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.139-0.140=-0.000
σ0.004-0.004=-0.000
min0.136-0.135=0.000
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.000
σ0.007-0.006=0.001
min43.386-43.386=0.000
max43.411-43.403=0.008
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.122-0.122=0.000
σ0.005-0.004=0.002
min0.115-0.119=-0.004
max0.131-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.961-1006.962=-0.001
σ0.920-0.866=0.054
min1006.496-1006.463=0.033
max1010.785-1010.541=0.244
mean1038.000-1047.550=-9.550
σ300.666-305.893=-5.228
min553.000-579.000=-26.000
max1584.000-1663.000=-79.000
mean1.566-1.528=0.038
σ0.132-0.088=0.044
min1.472-1.378=0.095
max1.997-1.799=0.198

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.003-0.003=0.000
min0.882
max0.887
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.426-0.413=0.013
σ0.156-0.113=0.044
min0.335-0.343=-0.008
max0.701-0.612=0.089
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.912-0.896=0.016
σ0.140-0.097=0.043
min0.830-0.839=-0.008
max1.160-1.066=0.093
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.543-0.539=0.004
σ0.051-0.053=-0.002
min0.507-0.489=0.017
max0.628-0.623=0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.846-0.855=-0.009
σ0.039-0.040=-0.001
min0.809-0.819=-0.010
max0.912-0.920=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.839=-0.002
σ0.029-0.033=-0.004
min964.815-964.809=0.006
max964.886-964.892=-0.006
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.833-0.847=-0.014
σ0.024-0.018=0.006
min0.805-0.821=-0.016
max0.859-0.870=-0.011
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=-0.000
min885.504-885.505=-0.001
max885.521-885.523=-0.001
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.731-0.720=0.011
σ0.028-0.014=0.013
min0.682-0.699=-0.018
max0.749-0.735=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean3.617-3.508=0.109
σ0.269-0.133=0.136
min3.380-2.910=0.471
max4.566-3.863=0.703
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean3.519-3.498=0.021
σ0.061-0.062=-0.001
min3.391-3.406=-0.015
max3.708-3.721=-0.013
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.747-0.748=-0.001
σ0.016-0.017=-0.000
min0.718-0.718=-0.000
max0.857-0.824=0.032
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.710-0.711=-0.001
σ0.015-0.014=0.001
min0.680-0.682=-0.001
max0.789-0.785=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.641-295.507=0.134
σ0.213-0.203=0.009
min295.465-295.389=0.077
max296.220-296.076=0.144
mean1911.000-1980.000=-69.000
σ0.000
min1911.000-1980.000=-69.000
max1911.000-1980.000=-69.000
mean0.599-0.537=0.062
σ0.035-0.035=-0.000
min0.568-0.485=0.083
max0.692-0.594=0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.402-285.403=-0.001
σ0.035-0.038=-0.003
min285.358-285.355=0.003
max285.437-285.442=-0.005
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.393-0.390=0.003
σ0.010-0.008=0.002
min0.381-0.381=0.000
max0.403-0.399=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.781-1295.777=0.005
σ0.107-0.107=0.000
min1295.664-1295.656=0.009
max1295.907-1295.897=0.010
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean1.903-1.913=-0.009
σ0.078-0.054=0.024
min1.815-1.825=-0.010
max1.987-1.958=0.029
iters=5
new-facts=6402
prior-facts=1
mean1539.904-1539.907=-0.002
σ6.883-6.880=0.002
min1536.632-1536.588=0.044
max1552.212-1552.209=0.003
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean2.227-2.295=-0.068
σ0.194-0.128=0.066
min1.995-2.136=-0.141
max2.466-2.494=-0.028
iters=5
new-facts=6402
prior-facts=6402
mean1857.681-1857.684=-0.004
σ0.063-0.065=-0.001
min1857.607-1857.622=-0.015
max1857.764-1857.763=0.001
mean1759.200-1784.400=-25.200
σ150.021-131.196=18.825
min1584.000-1663.000=-79.000
max1911.000-1980.000=-69.000
mean3.071-2.879=0.192
σ0.270-0.083=0.187
min2.866-2.806=0.060
max3.541-2.986=0.555

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.259-1.221=0.038
σ0.353-0.311=0.042
min0.931-0.945=-0.014
max1.782-1.694=0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.706-445.706=-0.000
σ580.934-580.934=-0.000
min155.236-155.236=0.000
max1317.107-1317.107=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean0.536-0.531=0.005
σ0.556-0.542=0.014
min0.256-0.259=-0.003
max1.370-1.344=0.025
policies=20
mean1552.660-1552.660=0.000
σ0.332-0.330=0.002
min1552.432-1552.434=-0.002
max1553.153-1553.150=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean2.591-2.591=0.000
σ0.017-0.020=-0.002
min2.575-2.570=0.004
max2.611-2.616=-0.005
policies=200
mean15534.619-15534.744=-0.124
σ0.081-0.084=-0.003
min15534.534-15534.670=-0.136
max15534.696-15534.865=-0.169
mean9200.000
σ0.000
min9200.000
max9200.000
mean1584.000-1663.000=-79.000
σ0.000
min1584.000-1663.000=-79.000
max1584.000-1663.000=-79.000
mean26.165-26.142=0.023
σ0.089-0.101=-0.012
min26.088-26.068=0.020
max26.292-26.292=0.000