Compare commits

Home / Compare 51e00e78 .. 06e55700

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.964=-0.000
σ0.369-0.370=-0.001
min53.825-53.818=0.006
max55.012-55.015=-0.003
mean417.000
σ0.000
min417.000
max417.000
mean0.138-0.136=0.002
σ0.003-0.004=-0.001
min0.133-0.131=0.002
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.006-0.007=-0.001
min43.315-43.312=0.003
max43.335-43.334=0.001
mean417.000
σ0.000
min417.000
max417.000
mean0.121-0.123=-0.002
σ0.001-0.003=-0.002
min0.119-0.120=-0.001
max0.123-0.129=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.514-1006.518=-0.003
σ1.164-1.175=-0.011
min1005.949-1005.949=0.001
max1011.388-1011.426=-0.038
mean1048.200-1038.600=9.600
σ314.278-311.237=3.041
min579.000-548.000=31.000
max1646.000-1507.000=139.000
mean1.548-1.556=-0.008
σ0.069-0.071=-0.002
min1.463-1.493=-0.030
max1.705-1.747=-0.041

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.421-0.428=-0.007
σ0.117-0.144=-0.027
min0.345-0.350=-0.005
max0.627-0.684=-0.057
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.891-0.910=-0.019
σ0.102-0.107=-0.005
min0.826-0.839=-0.013
max1.072-1.100=-0.028
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.540-0.546=-0.007
σ0.045-0.052=-0.008
min0.498-0.507=-0.009
max0.615-0.634=-0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.854-0.859=-0.005
σ0.047-0.045=0.002
min0.815-0.805=0.010
max0.930-0.926=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.827=0.012
σ0.035-0.035=0.000
min964.810-964.802=0.009
max964.898-964.889=0.009
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.816-0.807=0.009
σ0.050-0.086=-0.036
min0.753-0.659=0.094
max0.860-0.867=-0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.002
σ0.007-0.006=0.002
min885.504
max885.522-885.518=0.004
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.685-0.696=-0.011
σ0.115-0.043=0.073
min0.480-0.629=-0.148
max0.749-0.739=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean3.500-3.560=-0.061
σ0.069-0.107=-0.038
min3.355-3.396=-0.041
max3.799-4.106=-0.307
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean3.508-3.543=-0.035
σ0.092-0.069=0.023
min3.382-3.417=-0.035
max3.887-3.818=0.069
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.747-0.539=0.208
σ0.020-0.019=0.001
min0.662-0.513=0.149
max0.834-0.654=0.180
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.710-0.514=0.195
σ0.019-0.041=-0.022
min0.671-0.484=0.186
max0.796-0.894=-0.098

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.325-296.458=-0.132
σ0.249-0.207=0.042
min296.117-296.277=-0.160
max296.988-296.998=-0.011
mean2030.000-1924.000=106.000
σ0.000
min2030.000-1924.000=106.000
max2030.000-1924.000=106.000
mean0.559-0.592=-0.033
σ0.030-0.052=-0.022
min0.513-0.528=-0.015
max0.582-0.717=-0.136

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.025-285.028=-0.003
σ0.038-0.037=0.001
min284.977-284.978=-0.001
max285.066-285.072=-0.006
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.396-0.398=-0.003
σ0.008-0.007=0.000
min0.386-0.389=-0.003
max0.405-0.407=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.381-1295.427=-0.046
σ0.084-0.073=0.011
min1295.287-1295.346=-0.059
max1295.504-1295.493=0.011
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean1.925-2.067=-0.141
σ0.200-0.056=0.144
min1.787-2.008=-0.222
max2.246-2.158=0.087
iters=5
new-facts=6402
prior-facts=1
mean1539.632-1539.559=0.073
σ6.750-6.819=-0.069
min1536.490-1536.337=0.153
max1551.705-1551.754=-0.050
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean2.394-2.304=0.090
σ0.292-0.149=0.143
min2.144-2.132=0.012
max2.898-2.495=0.403
iters=5
new-facts=6402
prior-facts=6402
mean1857.326-1857.311=0.015
σ0.050-0.075=-0.025
min1857.268-1857.196=0.072
max1857.394-1857.380=0.015
mean1779.000-1756.400=22.600
σ168.935-181.467=-12.532
min1646.000-1507.000=139.000
max2030.000-1924.000=106.000
mean2.842-3.227=-0.385
σ0.056-0.257=-0.201
min2.775-2.945=-0.170
max2.927-3.518=-0.591

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.185-1.643=-0.459
σ0.264-0.221=0.043
min0.931-1.272=-0.341
max1.606-1.852=-0.246

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.192-448.190=0.003
σ581.334-581.331=0.002
min157.523-157.522=0.001
max1320.193-1320.187=0.006
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean0.547-0.555=-0.008
σ0.558-0.558=-0.001
min0.264-0.271=-0.006
max1.384-1.393=-0.009
policies=20
mean1575.571-1575.564=0.007
σ0.360-0.374=-0.014
min1575.330-1575.314=0.016
max1576.107-1576.120=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean2.657-2.661=-0.003
σ0.009-0.028=-0.018
min2.648-2.638=0.010
max2.670-2.700=-0.030
policies=200
mean15763.662-15763.675=-0.013
σ0.205-0.084=0.121
min15763.497-15763.553=-0.056
max15763.957-15763.741=0.216
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1507.000=139.000
σ0.000
min1646.000-1507.000=139.000
max1646.000-1507.000=139.000
mean26.671-26.725=-0.054
σ0.097-0.024=0.073
min26.588-26.703=-0.116
max26.803-26.758=0.045