Compare commits

Home / Compare b2b90d8d .. ba998b13

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.032=-0.001
σ0.369-0.369=0.000
min53.895-53.892=0.003
max55.081-55.081=0.000
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.139-0.140=-0.001
σ0.004-0.004=-0.000
min0.133-0.133=-0.001
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.382-43.384=-0.002
σ0.006-0.007=-0.000
min43.373-43.374=-0.001
max43.393-43.396=-0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.120-0.122=-0.002
σ0.004-0.003=0.000
min0.116-0.120=-0.004
max0.126-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.332-1006.331=0.001
σ0.883-0.912=-0.028
min1005.853-1005.859=-0.005
max1009.992-1010.118=-0.126
mean1051.600-1047.000=4.600
σ310.260-307.890=2.370
min567.000-551.000=16.000
max1644.000-1641.000=3.000
mean1.546-1.556=-0.010
σ0.059-0.098=-0.039
min1.489-1.486=0.003
max1.681-1.845=-0.164

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.423-0.418=0.005
σ0.129-0.134=-0.005
min0.355-0.348=0.008
max0.653-0.657=-0.003
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.002=0.000
min2.332
max2.337
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.902-0.887=0.015
σ0.090-0.092=-0.003
min0.823-0.818=0.005
max1.028-1.048=-0.020
name=heavy_item.art
mean1.521-1.522=-0.000
σ0.002-0.002=-0.001
min1.520
max1.524-1.525=-0.001
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.540-0.545=-0.005
σ0.039-0.051=-0.011
min0.505-0.500=0.005
max0.606-0.632=-0.026
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.001
min2.355
max2.358-2.360=-0.002
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.847-0.848=-0.002
σ0.044-0.037=0.007
min0.819-0.816=0.003
max0.924-0.910=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.557=-0.005
σ0.023-0.030=-0.007
min963.535-963.531=0.005
max963.590-963.608=-0.018
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.847-0.848=-0.000
σ0.011-0.020=-0.008
min0.830-0.815=0.014
max0.857-0.866=-0.010
name=cdr_enhanced_4k_loc.art
mean884.854-884.856=-0.002
σ0.009-0.005=0.003
min884.847
max884.866-884.860=0.006
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.690-0.727=-0.037
σ0.051-0.016=0.034
min0.610-0.709=-0.099
max0.745-0.740=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean4.006-3.495=0.511
σ0.359-0.063=0.296
min3.436-3.371=0.065
max4.566-3.761=0.805
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean4.233-3.495=0.738
σ0.083-0.077=0.006
min4.080-3.384=0.696
max4.491-3.809=0.682
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.749-0.740=0.009
σ0.026-0.025=0.000
min0.720-0.562=0.158
max0.934-0.852=0.082
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.700-0.619=0.081
σ0.044-0.095=-0.051
min0.498-0.493=0.005
max0.786-0.801=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.531-295.391=0.140
σ0.184-0.189=-0.005
min295.328-295.127=0.201
max296.001-295.831=0.170
mean1919.000-1906.000=13.000
σ0.000
min1919.000-1906.000=13.000
max1919.000-1906.000=13.000
mean0.585-0.595=-0.010
σ0.059-0.049=0.009
min0.503-0.495=0.008
max0.718-0.694=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.249-285.248=0.001
σ0.036-0.031=0.005
min285.201-285.209=-0.008
max285.286-285.282=0.004
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.392-0.386=0.005
σ0.009-0.010=-0.001
min0.384-0.380=0.005
max0.402-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.198-1295.199=-0.001
σ0.102-0.110=-0.008
min1295.058-1295.080=-0.022
max1295.309-1295.331=-0.022
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean2.001-1.932=0.069
σ0.269-0.095=0.174
min1.804-1.826=-0.022
max2.463-2.022=0.440
iters=5
new-facts=6402
prior-facts=1
mean1538.069-1538.083=-0.014
σ4.025-4.037=-0.013
min1536.076-1536.006=0.071
max1545.260-1545.293=-0.033
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean2.242-2.346=-0.104
σ0.177-0.287=-0.110
min2.038-2.029=0.009
max2.464-2.633=-0.169
iters=5
new-facts=6402
prior-facts=6402
mean1857.108-1857.105=0.004
σ0.052-0.056=-0.004
min1857.068-1857.053=0.016
max1857.187-1857.186=0.000
mean1776.800-1774.400=2.400
σ137.296-130.554=6.742
min1644.000-1641.000=3.000
max1919.000-1906.000=13.000
mean3.029-3.031=-0.001
σ0.357-0.343=0.014
min2.718-2.747=-0.029
max3.639-3.616=0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.465-1.275=0.190
σ0.195-0.286=-0.091
min1.268-1.001=0.267
max1.791-1.749=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.610=0.001
σ577.065-577.062=0.003
min155.077-155.077=-0.000
max1309.209-1309.203=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean0.550-0.538=0.012
σ0.567-0.551=0.016
min0.259-0.261=-0.002
max1.400-1.363=0.037
policies=20
mean1551.046-1551.042=0.004
σ0.330-0.323=0.007
min1550.821-1550.820=0.001
max1551.536-1551.521=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean2.585-2.589=-0.004
σ0.017-0.007=0.010
min2.570-2.579=-0.009
max2.604-2.595=0.009
policies=200
mean15518.476-15518.558=-0.083
σ0.149-0.076=0.073
min15518.311-15518.498=-0.187
max15518.644-15518.662=-0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1641.000=3.000
σ0.000
min1644.000-1641.000=3.000
max1644.000-1641.000=3.000
mean26.204-26.155=0.049
σ0.249-0.121=0.128
min26.011-26.031=-0.020
max26.570-26.308=0.261