Compare commits

Home / Compare 5cc713bc .. 9bf6c82d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.001
σ0.368-0.368=0.000
min53.916-53.920=-0.005
max55.103-55.104=-0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.139-0.141=-0.002
σ0.004-0.006=-0.001
min0.135-0.131=0.004
max0.147-0.149=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.395=-0.002
σ0.007-0.005=0.001
min43.385-43.388=-0.003
max43.406-43.404=0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.122-0.122=-0.000
σ0.003-0.003=0.000
min0.119-0.120=-0.001
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.984-1006.977=0.007
σ0.855-0.888=-0.033
min1006.483-1006.480=0.003
max1010.507-1010.663=-0.157
mean1047.200-1054.150=-6.950
σ314.016-315.259=-1.243
min577.000-574.000=3.000
max1645.000-1618.000=27.000
mean1.534-1.542=-0.008
σ0.082-0.060=0.022
min1.404-1.469=-0.065
max1.798-1.704=0.094

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.430-0.444=-0.013
σ0.144-0.122=0.021
min0.326-0.368=-0.041
max0.684-0.658=0.026
name=error_case.art
mean2.340-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.343-2.342=0.001
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.887-0.878=0.009
σ0.091-0.085=0.006
min0.812-0.818=-0.006
max1.046-1.028=0.018
name=heavy_item.art
mean1.524-1.525=-0.001
σ0.001-0.001=0.000
min1.522-1.524=-0.001
max1.525-1.526=-0.001
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.545-0.539=0.006
σ0.054-0.043=0.011
min0.496-0.507=-0.011
max0.632-0.613=0.019
name=nested_use.art
mean2.362-2.361=0.000
σ0.002-0.002=0.000
min2.360
max2.364
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.865-0.847=0.018
σ0.033-0.033=-0.000
min0.843-0.820=0.023
max0.924-0.904=0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.831=0.001
σ0.028-0.025=0.003
min964.810-964.802=0.008
max964.876-964.862=0.013
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.808-0.805=0.003
σ0.048-0.047=0.001
min0.748-0.728=0.020
max0.864-0.856=0.008
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=0.000
σ0.007-0.006=0.001
min885.504
max885.520-885.520=0.001
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.686-0.731=-0.045
σ0.057-0.016=0.042
min0.608-0.709=-0.100
max0.758-0.751=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean4.233-4.184=0.049
σ0.099-0.083=0.016
min4.098-4.059=0.039
max4.633-4.605=0.028
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean4.236-4.212=0.025
σ0.077-0.197=-0.120
min4.113-3.464=0.649
max4.536-4.549=-0.013
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.747-0.747=0.000
σ0.019-0.019=-0.001
min0.685-0.712=-0.027
max0.851-0.862=-0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.706-0.705=0.000
σ0.016-0.014=0.002
min0.635-0.674=-0.040
max0.764-0.781=-0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.627-295.456=0.171
σ0.258-0.227=0.031
min295.377-295.277=0.100
max296.311-296.060=0.251
mean1913.000-1899.000=14.000
σ0.000
min1913.000-1899.000=14.000
max1913.000-1899.000=14.000
mean0.575-0.578=-0.003
σ0.053-0.047=0.007
min0.513-0.502=0.011
max0.694-0.655=0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-285.408=-0.003
σ0.032-0.034=-0.003
min285.365-285.363=0.002
max285.441-285.443=-0.002
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.391-0.389=0.002
σ0.009-0.007=0.002
min0.381-0.380=0.000
max0.401-0.396=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.795-1295.768=0.027
σ0.114-0.112=0.002
min1295.666-1295.674=-0.008
max1295.947-1295.957=-0.010
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean1.978-2.001=-0.023
σ0.124-0.179=-0.055
min1.843-1.819=0.024
max2.132-2.232=-0.099
iters=5
new-facts=6402
prior-facts=1
mean1539.936-1540.035=-0.099
σ6.890-6.812=0.078
min1536.634-1536.862=-0.228
max1552.255-1552.218=0.037
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean2.345-2.471=-0.126
σ0.207-0.301=-0.094
min2.102-2.137=-0.035
max2.618-2.856=-0.238
iters=5
new-facts=6402
prior-facts=6402
mean1857.705-1857.711=-0.006
σ0.059-0.052=0.007
min1857.642-1857.652=-0.010
max1857.785-1857.779=0.006
mean1772.800-1764.800=8.000
σ134.715-131.525=3.191
min1645.000-1618.000=27.000
max1913.000-1899.000=14.000
mean2.971-3.088=-0.118
σ0.212-0.322=-0.110
min2.677-2.851=-0.174
max3.277-3.639=-0.362

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.344-1.368=-0.024
σ0.221-0.263=-0.043
min1.107-1.106=0.001
max1.702-1.798=-0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.740=0.001
σ580.934-580.933=0.001
min155.272-155.272=0.000
max1317.142-1317.140=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean0.534-0.556=-0.021
σ0.549-0.591=-0.042
min0.255-0.259=-0.004
max1.358-1.442=-0.084
policies=20
mean1552.990-1552.984=0.006
σ0.328-0.320=0.008
min1552.767-1552.766=0.002
max1553.478-1553.460=0.018
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean2.590-2.575=0.014
σ0.024-0.020=0.004
min2.569-2.552=0.016
max2.620-2.600=0.020
policies=200
mean15537.931-15538.045=-0.115
σ0.082-0.113=-0.031
min15537.839-15537.932=-0.093
max15538.012-15538.200=-0.189
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1618.000=27.000
σ0.000
min1645.000-1618.000=27.000
max1645.000-1618.000=27.000
mean26.122-26.141=-0.018
σ0.106-0.129=-0.023
min26.029-26.060=-0.031
max26.272-26.332=-0.060