Compare commits

Home / Compare b1ec9491 .. 94c52d14

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=-0.001
σ0.368-0.371=-0.002
min53.910-53.913=-0.003
max55.103-55.111=-0.008
mean417.000-416.700=0.300
σ0.000-0.483=-0.483
min417.000-416.000=1.000
max417.000
mean0.136-0.139=-0.003
σ0.004-0.004=-0.000
min0.130-0.132=-0.002
max0.143-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.006-0.007=-0.000
min43.384-43.383=0.001
max43.403-43.405=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.122-0.123=-0.001
σ0.003-0.003=0.000
min0.118-0.120=-0.002
max0.128-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.967-1006.960=0.007
σ0.856-0.875=-0.019
min1006.463-1006.463=-0.000
max1010.493-1010.586=-0.093
mean1056.500-1050.500=6.000
σ316.126-313.503=2.623
min567.000-565.000=2.000
max1620.000-1649.000=-29.000
mean1.542-1.556=-0.014
σ0.070-0.057=0.014
min1.467-1.491=-0.024
max1.784-1.661=0.123

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.416-0.431=-0.016
σ0.144-0.135=0.008
min0.320-0.335=-0.015
max0.669-0.660=0.009
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.893-0.894=-0.001
σ0.091-0.093=-0.003
min0.836-0.829=0.007
max1.053-1.058=-0.005
name=heavy_item.art
mean1.524-1.524=-0.001
σ0.002-0.003=-0.001
min1.522
max1.526-1.529=-0.003
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.543-0.540=0.003
σ0.047-0.039=0.007
min0.505-0.510=-0.005
max0.621-0.608=0.013
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.851-0.855=-0.004
σ0.048-0.034=0.014
min0.817-0.825=-0.008
max0.936-0.912=0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.036-0.034=0.002
min964.811-964.810=0.001
max964.897-964.895=0.002
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.833-0.841=-0.008
σ0.023-0.029=-0.007
min0.801-0.789=0.012
max0.857-0.861=-0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.006-0.007=-0.001
min885.504-885.505=-0.001
max885.519-885.523=-0.003
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.729-0.727=0.002
σ0.034-0.015=0.019
min0.669-0.702=-0.033
max0.751-0.739=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean4.204-3.530=0.674
σ0.074-0.075=-0.001
min4.077-3.406=0.671
max4.490-3.708=0.782
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean4.217-3.516=0.701
σ0.063-0.069=-0.006
min4.087-3.362=0.725
max4.450-3.704=0.746
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.754-0.553=0.201
σ0.025-0.026=-0.000
min0.722-0.518=0.203
max0.908-0.686=0.222
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.709-0.512=0.197
σ0.014-0.011=0.003
min0.678-0.493=0.185
max0.795-0.577=0.219

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.554-295.499=0.055
σ0.234-0.238=-0.004
min295.379-295.350=0.029
max296.193-296.158=0.035
mean2071.000-1967.000=104.000
σ0.000
min2071.000-1967.000=104.000
max2071.000-1967.000=104.000
mean0.542-0.530=0.012
σ0.035-0.025=0.010
min0.498-0.501=-0.004
max0.593-0.575=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.395-285.392=0.003
σ0.037-0.039=-0.001
min285.341-285.343=-0.001
max285.431-285.433=-0.002
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.388-0.387=0.001
σ0.009-0.005=0.004
min0.380-0.382=-0.002
max0.402-0.393=0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.758-1295.772=-0.014
σ0.089-0.098=-0.010
min1295.652-1295.662=-0.010
max1295.869-1295.887=-0.017
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean1.851-1.954=-0.103
σ0.082-0.112=-0.030
min1.759-1.832=-0.073
max1.953-2.095=-0.141
iters=5
new-facts=6402
prior-facts=1
mean1539.913-1539.891=0.022
σ6.854-6.887=-0.033
min1536.571-1536.570=0.001
max1552.166-1552.206=-0.040
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean2.351-2.277=0.074
σ0.196-0.188=0.008
min2.106-1.989=0.117
max2.582-2.517=0.066
iters=5
new-facts=6402
prior-facts=6402
mean1857.691-1857.687=0.004
σ0.062-0.066=-0.004
min1857.616-1857.610=0.006
max1857.759-1857.765=-0.006
mean1773.000-1778.800=-5.800
σ189.805-126.314=63.491
min1620.000-1649.000=-29.000
max2071.000-1967.000=104.000
mean2.897-2.934=-0.038
σ0.178-0.061=0.117
min2.666-2.845=-0.179
max3.153-2.995=0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.261-1.193=0.069
σ0.369-0.289=0.080
min0.937-0.937=-0.000
max1.838-1.667=0.170

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.745-445.743=0.002
σ581.009-581.010=-0.001
min155.239-155.234=0.005
max1317.258-1317.257=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean0.541-0.538=0.004
σ0.563-0.548=0.015
min0.258-0.260=-0.002
max1.386-1.359=0.027
policies=20
mean1552.647-1552.652=-0.005
σ0.329-0.337=-0.008
min1552.421-1552.419=0.002
max1553.135-1553.152=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean2.586-2.607=-0.022
σ0.018-0.018=0.000
min2.564-2.592=-0.028
max2.603-2.632=-0.029
policies=200
mean15534.639-15534.736=-0.098
σ0.055-0.138=-0.083
min15534.573-15534.641=-0.068
max15534.705-15534.939=-0.234
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1649.000=-29.000
σ0.000
min1620.000-1649.000=-29.000
max1620.000-1649.000=-29.000
mean26.062-26.080=-0.018
σ0.135-0.033=0.103
min25.937-26.048=-0.111
max26.252-26.108=0.144