Compare commits

Home / Compare a248b3c2 .. 2b70c76a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.963=0.002
σ0.370-0.369=0.001
min53.822-53.826=-0.004
max55.018-55.014=0.004
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.139-0.137=0.002
σ0.004-0.004=0.000
min0.136-0.132=0.004
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.008-0.006=0.001
min43.309-43.312=-0.003
max43.338-43.333=0.005
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.121-0.122=-0.000
σ0.002-0.005=-0.002
min0.118-0.116=0.003
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.510-1006.513=-0.003
σ1.199-1.177=0.021
min1005.976-1005.978=-0.001
max1011.544-1011.432=0.111
mean1056.500-1044.100=12.400
σ320.726-315.200=5.526
min544.000-546.000=-2.000
max1626.000-1525.000=101.000
mean1.556-1.560=-0.004
σ0.084-0.083=0.001
min1.486-1.469=0.017
max1.779-1.798=-0.019

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.003-0.003=-0.000
min0.882
max0.887-0.887=-0.000
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.443-0.425=0.018
σ0.180-0.140=0.040
min0.328-0.334=-0.006
max0.763-0.672=0.090
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.931-0.903=0.027
σ0.165-0.103=0.062
min0.833-0.842=-0.009
max1.222-1.085=0.137
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.541-0.548=-0.007
σ0.044-0.052=-0.008
min0.499-0.501=-0.002
max0.614-0.633=-0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.851-0.857=-0.006
σ0.045-0.043=0.001
min0.816-0.817=-0.001
max0.927-0.930=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.829=0.011
σ0.034-0.036=-0.003
min964.812-964.802=0.011
max964.896-964.892=0.004
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.803-0.840=-0.037
σ0.027-0.018=0.009
min0.785-0.820=-0.035
max0.847-0.856=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.005=0.002
min885.504
max885.522-885.517=0.005
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.732-0.735=-0.003
σ0.017-0.010=0.007
min0.703-0.720=-0.018
max0.744-0.748=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean4.210-3.560=0.649
σ0.083-0.093=-0.011
min4.095-3.386=0.709
max4.515-3.903=0.612
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean3.693-3.537=0.156
σ0.344-0.077=0.268
min3.343-3.388=-0.045
max4.334-3.778=0.556
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.743-0.745=-0.002
σ0.018-0.017=0.001
min0.711-0.716=-0.005
max0.848-0.849=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.542-0.707=-0.165
σ0.074-0.016=0.058
min0.488-0.678=-0.190
max0.777-0.783=-0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.408-296.421=-0.014
σ0.224-0.211=0.012
min296.285-296.129=0.156
max297.030-296.799=0.231
mean2028.000-2022.000=6.000
σ0.000
min2028.000-2022.000=6.000
max2028.000-2022.000=6.000
mean0.560-0.551=0.009
σ0.029-0.034=-0.005
min0.504-0.508=-0.003
max0.581-0.593=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.030-285.024=0.006
σ0.040-0.035=0.005
min284.976-284.974=0.003
max285.071-285.060=0.010
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.403-0.395=0.008
σ0.012-0.007=0.005
min0.384-0.388=-0.004
max0.413-0.405=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.430-1295.430=0.000
σ0.121-0.057=0.063
min1295.298-1295.381=-0.084
max1295.590-1295.496=0.094
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean1.893-2.059=-0.166
σ0.079-0.080=-0.000
min1.819-1.989=-0.170
max2.006-2.193=-0.188
iters=5
new-facts=6402
prior-facts=1
mean1539.516-1539.573=-0.057
σ6.856-6.822=0.034
min1536.231-1536.365=-0.134
max1551.776-1551.774=0.003
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean2.236-2.360=-0.124
σ0.225-0.254=-0.029
min1.932-2.117=-0.185
max2.456-2.729=-0.273
iters=5
new-facts=6402
prior-facts=6402
mean1857.325-1857.321=0.004
σ0.061-0.078=-0.018
min1857.258-1857.199=0.059
max1857.402-1857.396=0.006
mean1776.800-1735.000=41.800
σ173.573-208.716=-35.143
min1626.000-1525.000=101.000
max2028.000-2022.000=6.000
mean3.118-2.917=0.201
σ0.288-0.092=0.196
min2.848-2.795=0.053
max3.553-3.034=0.519

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.262-1.611=-0.350
σ0.387-0.231=0.155
min0.938-1.240=-0.302
max1.889-1.784=0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.193-448.193=0.000
σ581.341-581.340=0.001
min157.519-157.521=-0.003
max1320.205-1320.204=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean0.541-0.546=-0.006
σ0.553-0.572=-0.018
min0.252-0.257=-0.004
max1.370-1.403=-0.033
policies=20
mean1575.555-1575.544=0.011
σ0.358-0.358=0.001
min1575.314-1575.300=0.014
max1576.088-1576.075=0.013
mean920.000
σ0.000
min920.000
max920.000
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean2.630-2.632=-0.002
σ0.027-0.010=0.017
min2.602-2.621=-0.019
max2.666-2.645=0.021
policies=200
mean15763.671-15763.577=0.093
σ0.097-0.105=-0.008
min15763.530-15763.492=0.037
max15763.749-15763.729=0.021
mean9200.000
σ0.000
min9200.000
max9200.000
mean1626.000-1525.000=101.000
σ0.000
min1626.000-1525.000=101.000
max1626.000-1525.000=101.000
mean26.562-26.633=-0.071
σ0.025-0.022=0.003
min26.532-26.605=-0.072
max26.594-26.659=-0.065