Compare commits

Home / Compare 0d637649 .. d1b3d03e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.001
σ0.367-0.370=-0.004
min53.914-53.914=0.000
max55.098-55.110=-0.012
mean417.700-414.000=3.700
σ0.483-0.000=0.483
min417.000-414.000=3.000
max418.000-414.000=4.000
mean0.137-0.137=-0.000
σ0.005-0.004=0.001
min0.130-0.131=-0.002
max0.146-0.142=0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.005-0.007=-0.002
min43.386-43.384=0.002
max43.403-43.406=-0.003
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.123-0.123=0.001
σ0.004-0.004=-0.000
min0.119-0.119=0.001
max0.129-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.963=0.016
σ0.886-0.878=0.008
min1006.490-1006.462=0.028
max1010.654-1010.597=0.056
mean1046.600-1043.350=3.250
σ314.288-306.013=8.275
min577.000-575.000=2.000
max1645.000-1659.000=-14.000
mean1.574-1.571=0.003
σ0.103-0.083=0.020
min1.494-1.492=0.002
max1.824-1.839=-0.016

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.422-0.415=0.007
σ0.147-0.140=0.007
min0.333-0.331=0.003
max0.682-0.661=0.021
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.873-0.884=-0.011
σ0.089-0.102=-0.014
min0.823-0.813=0.010
max1.031-1.062=-0.031
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.536-0.534=0.002
σ0.047-0.054=-0.007
min0.489-0.494=-0.006
max0.614-0.627=-0.012
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.838-0.856=-0.018
σ0.045-0.033=0.012
min0.795-0.826=-0.030
max0.906-0.910=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.839=-0.010
σ0.025-0.034=-0.009
min964.802-964.811=-0.009
max964.862-964.895=-0.033
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.845-0.829=0.015
σ0.036-0.059=-0.023
min0.780-0.724=0.056
max0.865-0.864=0.002
name=cdr_enhanced_4k_loc.art
mean885.515-885.512=0.003
σ0.004-0.007=-0.003
min885.509-885.504=0.005
max885.520-885.520=-0.001
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.712-0.698=0.014
σ0.046-0.032=0.014
min0.636-0.666=-0.030
max0.748-0.734=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean4.273-4.255=0.018
σ0.104-0.075=0.029
min4.089-4.113=-0.024
max4.931-4.515=0.416
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean4.254-4.262=-0.007
σ0.076-0.075=0.001
min4.111-4.089=0.023
max4.543-4.526=0.017
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.745-0.753=-0.008
σ0.018-0.018=-0.001
min0.712-0.725=-0.013
max0.848-0.868=-0.020
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.703-0.716=-0.013
σ0.019-0.015=0.004
min0.593-0.688=-0.095
max0.764-0.792=-0.028

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.480-295.406=0.073
σ0.230-0.243=-0.013
min295.310-295.267=0.043
max296.086-296.080=0.006
mean1898.000-1913.000=-15.000
σ0.000
min1898.000-1913.000=-15.000
max1898.000-1913.000=-15.000
mean0.602-0.580=0.022
σ0.038-0.051=-0.013
min0.527-0.498=0.029
max0.685-0.682=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-285.398=0.013
σ0.040-0.038=0.003
min285.357-285.343=0.015
max285.455-285.438=0.017
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.398-0.392=0.006
σ0.009-0.007=0.001
min0.389-0.384=0.005
max0.412-0.402=0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.781=0.014
σ0.112-0.113=-0.002
min1295.675-1295.664=0.011
max1295.928-1295.914=0.014
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean1.912-1.883=0.029
σ0.085-0.076=0.010
min1.833-1.799=0.035
max2.038-1.974=0.064
iters=5
new-facts=6402
prior-facts=1
mean1539.914-1539.897=0.017
σ6.902-6.879=0.023
min1536.632-1536.605=0.027
max1552.257-1552.198=0.059
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean2.260-2.268=-0.008
σ0.247-0.237=0.009
min2.019-1.971=0.047
max2.527-2.460=0.067
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.682=0.027
σ0.051-0.066=-0.016
min1857.654-1857.606=0.048
max1857.776-1857.777=-0.001
mean1769.800-1784.200=-14.400
σ123.647-127.064=-3.416
min1645.000-1659.000=-14.000
max1898.000-1913.000=-15.000
mean3.117-3.025=0.092
σ0.305-0.277=0.027
min2.869-2.706=0.163
max3.639-3.464=0.175

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.367-1.246=0.121
σ0.282-0.369=-0.087
min1.121-0.941=0.179
max1.854-1.845=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.707=0.033
σ580.935-580.934=0.001
min155.271-155.239=0.032
max1317.142-1317.108=0.034
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean0.527-0.545=-0.018
σ0.536-0.552=-0.016
min0.255-0.265=-0.009
max1.332-1.374=-0.042
policies=20
mean1552.968-1552.665=0.304
σ0.325-0.341=-0.016
min1552.746-1552.434=0.312
max1553.452-1553.171=0.281
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean2.599-2.609=-0.011
σ0.028-0.021=0.007
min2.582-2.587=-0.004
max2.641-2.638=0.003
policies=200
mean15537.933-15534.643=3.290
σ0.078-0.174=-0.096
min15537.834-15534.493=3.341
max15538.006-15534.879=3.127
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1659.000=-14.000
σ0.000
min1645.000-1659.000=-14.000
max1645.000-1659.000=-14.000
mean26.251-26.239=0.011
σ0.130-0.117=0.013
min26.154-26.138=0.015
max26.435-26.408=0.027