Compare commits

Home / Compare cdbfa016 .. f8b9b508

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.368-0.368=0.000
min53.916-53.910=0.006
max55.103-55.103=0.000
mean416.000-413.500=2.500
σ0.000-0.527=-0.527
min416.000-413.000=3.000
max416.000-414.000=2.000
mean0.139-0.137=0.002
σ0.004-0.004=0.001
min0.135-0.131=0.003
max0.147-0.142=0.005
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.006=0.001
min43.385-43.388=-0.003
max43.406-43.402=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.122-0.123=-0.001
σ0.003-0.003=0.000
min0.119-0.120=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.984-1006.978=0.006
σ0.855-0.871=-0.016
min1006.483-1006.482=0.001
max1010.507-1010.581=-0.074
mean1047.200-1047.650=-0.450
σ314.016-307.736=6.280
min577.000-553.000=24.000
max1645.000-1642.000=3.000
mean1.534-1.546=-0.011
σ0.082-0.072=0.011
min1.404-1.481=-0.077
max1.798-1.753=0.045

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.002-0.002=0.000
min0.882
max0.887
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.430-0.421=0.009
σ0.144-0.138=0.006
min0.326-0.336=-0.010
max0.684-0.666=0.017
name=error_case.art
mean2.340-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.343-2.342=0.001
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.887-0.882=0.005
σ0.091-0.089=0.003
min0.812-0.814=-0.003
max1.046-1.034=0.012
name=heavy_item.art
mean1.524-1.523=0.001
σ0.001-0.001=-0.000
min1.522
max1.525
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.545-0.544=0.001
σ0.054-0.043=0.011
min0.496-0.508=-0.012
max0.632-0.615=0.017
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.865-0.837=0.028
σ0.033-0.038=-0.005
min0.843-0.800=0.044
max0.924-0.895=0.028

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.835=-0.003
σ0.028-0.031=-0.003
min964.810-964.807=0.003
max964.876-964.888=-0.013
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.808-0.832=-0.023
σ0.048-0.048=0.000
min0.748-0.750=-0.001
max0.864-0.872=-0.008
name=cdr_enhanced_4k_loc.art
mean885.514-885.515=-0.000
σ0.007-0.005=0.002
min885.504-885.508=-0.004
max885.520-885.519=0.002
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.686-0.698=-0.012
σ0.057-0.042=0.016
min0.608-0.643=-0.035
max0.758-0.734=0.024

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean4.233-3.498=0.735
σ0.099-0.090=0.009
min4.098-3.326=0.772
max4.633-4.069=0.563
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean4.236-3.477=0.760
σ0.077-0.080=-0.003
min4.113-3.365=0.748
max4.536-3.762=0.774
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.747-0.744=0.004
σ0.019-0.027=-0.009
min0.685-0.570=0.115
max0.851-0.856=-0.005
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.706-0.581=0.125
σ0.016-0.099=-0.082
min0.635-0.487=0.148
max0.764-0.788=-0.024

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.627-295.380=0.247
σ0.258-0.165=0.093
min295.377-295.277=0.100
max296.311-295.832=0.479
mean1913.000-1906.000=7.000
σ0.000
min1913.000-1906.000=7.000
max1913.000-1906.000=7.000
mean0.575-0.574=0.001
σ0.053-0.041=0.012
min0.513-0.493=0.020
max0.694-0.627=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-285.413=-0.007
σ0.032-0.037=-0.005
min285.365-285.368=-0.003
max285.441-285.453=-0.012
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.391-0.387=0.005
σ0.009-0.007=0.002
min0.381-0.380=0.001
max0.401-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.794=0.000
σ0.114-0.114=0.000
min1295.666-1295.663=0.003
max1295.947-1295.936=0.011
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean1.978-1.988=-0.010
σ0.124-0.276=-0.152
min1.843-1.797=0.046
max2.132-2.467=-0.335
iters=5
new-facts=6402
prior-facts=1
mean1539.936-1539.974=-0.037
σ6.890-6.833=0.057
min1536.634-1536.707=-0.073
max1552.255-1552.192=0.063
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean2.345-2.403=-0.057
σ0.207-0.238=-0.031
min2.102-2.052=0.049
max2.618-2.635=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean1857.705-1857.706=-0.001
σ0.059-0.056=0.004
min1857.642-1857.654=-0.012
max1857.785-1857.784=0.001
mean1772.800-1774.200=-1.400
σ134.715-130.550=4.166
min1645.000-1642.000=3.000
max1913.000-1906.000=7.000
mean2.971-3.056=-0.086
σ0.212-0.272=-0.060
min2.677-2.842=-0.165
max3.277-3.525=-0.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.306=0.039
σ0.221-0.279=-0.058
min1.107-1.098=0.009
max1.702-1.779=-0.077

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.742=-0.001
σ580.934-580.937=-0.002
min155.272-155.270=0.002
max1317.142-1317.147=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean0.534-0.544=-0.010
σ0.549-0.561=-0.011
min0.255-0.262=-0.007
max1.358-1.385=-0.026
policies=20
mean1552.990-1552.990=0.000
σ0.328-0.325=0.003
min1552.767-1552.768=-0.000
max1553.478-1553.472=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean2.590-2.586=0.004
σ0.024-0.009=0.015
min2.569-2.575=-0.007
max2.620-2.594=0.026
policies=200
mean15537.931-15537.740=0.191
σ0.082-0.469=-0.388
min15537.839-15537.052=0.787
max15538.012-15538.071=-0.060
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1642.000=3.000
σ0.000
min1645.000-1642.000=3.000
max1645.000-1642.000=3.000
mean26.122-26.183=-0.061
σ0.106-0.213=-0.107
min26.029-26.024=0.005
max26.272-26.497=-0.224