Compare commits

Home / Compare d5266474 .. f593980e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.031=0.001
σ0.369-0.369=-0.000
min53.883-53.889=-0.006
max55.082-55.082=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.139-0.139=-0.000
σ0.005-0.004=0.001
min0.133-0.135=-0.003
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.384-43.386=-0.002
σ0.004-0.007=-0.003
min43.376-43.377=-0.001
max43.390-43.397=-0.007
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.123-0.123=-0.000
σ0.004-0.004=0.000
min0.119-0.119=0.000
max0.129-0.130=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.336-1006.337=-0.001
σ0.868-0.864=0.004
min1005.835-1005.834=0.000
max1009.922-1009.903=0.019
mean1048.000-1041.150=6.850
σ307.019-306.067=0.952
min572.000
max1643.000-1658.000=-15.000
mean1.558-1.551=0.006
σ0.058-0.049=0.009
min1.489-1.499=-0.010
max1.671-1.644=0.027

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.425-0.409=0.016
σ0.165-0.103=0.062
min0.324-0.350=-0.025
max0.718-0.592=0.125
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.930-0.877=0.053
σ0.208-0.086=0.122
min0.820-0.817=0.003
max1.299-1.029=0.270
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.542-0.538=0.004
σ0.045-0.052=-0.007
min0.504-0.507=-0.003
max0.618-0.631=-0.013
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.840-0.864=-0.024
σ0.044-0.078=-0.034
min0.809-0.801=0.007
max0.914-0.996=-0.083

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.551=0.001
σ0.025-0.034=-0.009
min963.523-963.527=-0.004
max963.585-963.611=-0.026
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.835-0.837=-0.002
σ0.023-0.032=-0.009
min0.807-0.785=0.021
max0.865-0.860=0.004
name=cdr_enhanced_4k_loc.art
mean884.856-884.855=0.001
σ0.005-0.006=-0.001
min884.848
max884.860-884.863=-0.002
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.702-0.694=0.008
σ0.056-0.066=-0.011
min0.612-0.603=0.010
max0.745-0.751=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.713-7.711=0.003
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean4.299-4.258=0.041
σ0.082-0.088=-0.006
min4.161-4.093=0.067
max4.554-4.612=-0.058
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean4.262-4.266=-0.004
σ0.070-0.082=-0.012
min4.127-4.134=-0.007
max4.485-4.528=-0.044
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.754-0.753=0.001
σ0.035-0.033=0.001
min0.705-0.721=-0.016
max0.949-0.959=-0.010
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.713-0.706=0.007
σ0.014-0.023=-0.008
min0.684-0.534=0.149
max0.785-0.808=-0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.537-295.518=0.019
σ0.249-0.164=0.084
min295.339-295.327=0.012
max296.208-295.909=0.299
mean1916.000-1907.000=9.000
σ0.000
min1916.000-1907.000=9.000
max1916.000-1907.000=9.000
mean0.554-0.586=-0.031
σ0.045-0.050=-0.005
min0.499-0.494=0.005
max0.600-0.681=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.252=-0.002
σ0.040-0.035=0.005
min285.199-285.206=-0.007
max285.292-285.288=0.003
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.390-0.401=-0.010
σ0.011-0.008=0.003
min0.381-0.389=-0.008
max0.404-0.409=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.193-1295.198=-0.005
σ0.114-0.109=0.005
min1295.064-1295.078=-0.015
max1295.326-1295.324=0.002
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean2.005-1.930=0.076
σ0.257-0.094=0.164
min1.826-1.821=0.006
max2.450-2.021=0.429
iters=5
new-facts=6402
prior-facts=1
mean1538.070-1538.082=-0.012
σ4.029-4.022=0.007
min1536.069-1536.052=0.017
max1545.268-1545.269=-0.001
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean2.247-2.250=-0.003
σ0.171-0.182=-0.011
min2.033-2.054=-0.021
max2.457-2.506=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean1857.108-1857.105=0.003
σ0.052-0.049=0.003
min1857.055-1857.066=-0.011
max1857.180-1857.181=-0.001
mean1776.600-1780.600=-4.000
σ134.975-124.572=10.403
min1643.000-1658.000=-15.000
max1916.000-1907.000=9.000
mean3.108-3.051=0.058
σ0.247-0.342=-0.095
min2.885-2.845=0.040
max3.530-3.658=-0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.370-1.506=-0.136
σ0.203-0.249=-0.046
min1.193-1.270=-0.077
max1.709-1.856=-0.147

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.611=-0.001
σ577.065-577.065=-0.000
min155.076-155.077=-0.001
max1309.207-1309.208=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean0.520-0.538=-0.018
σ0.524-0.558=-0.034
min0.257-0.255=0.002
max1.306-1.376=-0.070
policies=20
mean1551.040-1551.046=-0.005
σ0.340-0.331=0.008
min1550.809-1550.819=-0.010
max1551.545-1551.538=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean2.598-2.600=-0.003
σ0.010-0.026=-0.015
min2.591-2.571=0.020
max2.613-2.630=-0.017
policies=200
mean15518.581-15518.443=0.137
σ0.117-0.157=-0.039
min15518.441-15518.327=0.114
max15518.717-15518.663=0.054
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1658.000=-15.000
σ0.000
min1643.000-1658.000=-15.000
max1643.000-1658.000=-15.000
mean26.158-26.142=0.016
σ0.125-0.145=-0.020
min26.089-26.038=0.051
max26.346-26.353=-0.007