Compare commits

Home / Compare 4304af12 .. dd4647e5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.966=-0.000
σ0.369-0.369=0.000
min53.824-53.818=0.006
max55.015-55.014=0.001
mean416.800-413.000=3.800
σ0.422-0.000=0.422
min416.000-413.000=3.000
max417.000-413.000=4.000
mean0.143-0.138=0.004
σ0.010-0.005=0.004
min0.136-0.131=0.005
max0.167-0.146=0.021
cache=y
dps=1
iters=10
policies=100
mean43.323-43.321=0.002
σ0.007-0.007=-0.001
min43.314-43.314=0.001
max43.337-43.338=-0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.118-0.121=-0.003
σ0.004-0.004=0.000
min0.113-0.114=-0.001
max0.127-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.517=-0.003
σ1.168-1.156=0.012
min1005.950-1005.948=0.003
max1011.411-1011.353=0.058
mean1056.000-1038.050=17.950
σ315.655-310.154=5.500
min568.000-548.000=20.000
max1617.000-1505.000=112.000
mean1.543-1.513=0.030
σ0.052-0.058=-0.007
min1.487-1.435=0.052
max1.652-1.628=0.025

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.882
max0.887-0.887=-0.000
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.436-0.423=0.013
σ0.185-0.145=0.040
min0.337-0.343=-0.006
max0.766-0.681=0.085
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.913-0.889=0.024
σ0.166-0.111=0.055
min0.819-0.821=-0.002
max1.209-1.084=0.124
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.528-0.533=-0.005
σ0.054-0.054=0.000
min0.495-0.496=-0.002
max0.623-0.621=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.842-0.848=-0.006
σ0.034-0.039=-0.005
min0.818-0.819=-0.002
max0.902-0.916=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.826=0.013
σ0.029-0.034=-0.005
min964.817-964.802=0.015
max964.887-964.886=0.000
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.825-0.770=0.055
σ0.031-0.099=-0.068
min0.778-0.655=0.123
max0.854-0.862=-0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.003
σ0.008-0.006=0.002
min885.504
max885.522-885.516=0.006
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.727-0.684=0.043
σ0.029-0.083=-0.054
min0.676-0.538=0.138
max0.743-0.736=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean4.224-4.228=-0.003
σ0.077-0.093=-0.016
min4.087-4.046=0.041
max4.575-4.614=-0.039
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean4.241-4.228=0.013
σ0.103-0.081=0.022
min3.759-4.119=-0.360
max4.526-4.517=0.009
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.745-0.741=0.004
σ0.018-0.016=0.002
min0.714-0.708=0.006
max0.861-0.823=0.039
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.707-0.699=0.008
σ0.013-0.015=-0.002
min0.678-0.669=0.009
max0.765-0.781=-0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.423-296.210=0.214
σ0.204-0.227=-0.023
min296.218-296.047=0.171
max296.946-296.830=0.116
mean2031.000-1909.000=122.000
σ0.000
min2031.000-1909.000=122.000
max2031.000-1909.000=122.000
mean0.565-0.579=-0.014
σ0.041-0.044=-0.003
min0.502-0.514=-0.012
max0.600-0.682=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.026-285.035=-0.009
σ0.031-0.035=-0.005
min284.983-284.989=-0.005
max285.068-285.069=-0.001
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.398-0.395=0.002
σ0.009-0.008=0.001
min0.389-0.387=0.002
max0.408-0.405=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.420-1295.411=0.009
σ0.109-0.115=-0.006
min1295.299-1295.296=0.003
max1295.555-1295.579=-0.024
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean1.887-1.895=-0.008
σ0.096-0.078=0.018
min1.800-1.805=-0.005
max2.032-1.995=0.037
iters=5
new-facts=6402
prior-facts=1
mean1539.525-1539.522=0.003
σ6.847-6.853=-0.006
min1536.250-1536.233=0.017
max1551.771-1551.775=-0.004
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean2.266-2.268=-0.002
σ0.275-0.202=0.073
min2.043-2.084=-0.041
max2.695-2.493=0.202
iters=5
new-facts=6402
prior-facts=6402
mean1857.334-1857.315=0.019
σ0.055-0.064=-0.009
min1857.265-1857.236=0.029
max1857.406-1857.402=0.004
mean1768.000-1748.000=20.000
σ181.350-171.613=9.738
min1617.000-1508.000=109.000
max2031.000-1909.000=122.000
mean2.817-3.069=-0.252
σ0.109-0.249=-0.140
min2.691-2.870=-0.179
max2.955-3.492=-0.536

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.176-1.665=-0.489
σ0.312-0.260=0.052
min0.938-1.265=-0.327
max1.694-1.869=-0.175

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-448.191=-0.002
σ581.331-581.331=-0.000
min157.521-157.523=-0.003
max1320.186-1320.188=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean0.542-0.549=-0.008
σ0.556-0.573=-0.017
min0.262-0.260=0.002
max1.376-1.409=-0.033
policies=20
mean1575.555-1575.569=-0.015
σ0.363-0.354=0.009
min1575.314-1575.331=-0.017
max1576.095-1576.095=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean2.641-2.622=0.019
σ0.017-0.022=-0.005
min2.624-2.606=0.018
max2.659-2.653=0.006
policies=200
mean15763.562-15763.756=-0.194
σ0.094-0.098=-0.004
min15763.492-15763.676=-0.184
max15763.701-15763.897=-0.196
mean9200.000
σ0.000
min9200.000
max9200.000
mean1617.000-1505.000=112.000
σ0.000
min1617.000-1505.000=112.000
max1617.000-1505.000=112.000
mean26.601-26.464=0.137
σ0.055-0.034=0.021
min26.544-26.418=0.126
max26.675-26.491=0.184