Compare commits

Home / Compare 36b501d4 .. 3ccb2c48

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.001
σ0.370-0.368=0.003
min53.908-53.910=-0.003
max55.109-55.101=0.008
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.140-0.140=0.000
σ0.004-0.004=0.000
min0.137-0.136=0.000
max0.149-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.001
σ0.007-0.007=0.000
min43.381-43.382=-0.001
max43.407-43.403=0.003
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.124-0.122=0.002
σ0.004-0.004=0.001
min0.119-0.118=0.001
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.981=-0.002
σ0.865-0.861=0.004
min1006.479-1006.482=-0.003
max1010.557-1010.535=0.022
mean1056.900-1051.600=5.300
σ321.885-310.935=10.950
min579.000-555.000=24.000
max1638.000-1649.000=-11.000
mean1.534-1.547=-0.013
σ0.090-0.071=0.019
min1.443-1.482=-0.039
max1.864-1.761=0.103

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.414-0.421=-0.007
σ0.117-0.142=-0.025
min0.338-0.344=-0.006
max0.619-0.674=-0.055
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.872-0.875=-0.003
σ0.084-0.084=0.000
min0.814-0.815=-0.001
max1.018-1.022=-0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.530-0.533=-0.002
σ0.051-0.052=-0.001
min0.500-0.477=0.023
max0.619-0.617=0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.842-0.843=-0.001
σ0.020-0.039=-0.019
min0.827-0.815=0.012
max0.874-0.909=-0.035

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.836=-0.005
σ0.024-0.031=-0.007
min964.802-964.811=-0.009
max964.861-964.889=-0.029
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.772-0.804=-0.032
σ0.049-0.018=0.031
min0.723-0.777=-0.055
max0.844-0.826=0.018
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.008-0.004=0.004
min885.504-885.508=-0.003
max885.522-885.517=0.004
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.691-0.693=-0.003
σ0.044-0.063=-0.019
min0.643-0.588=0.055
max0.745-0.748=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean4.209-4.197=0.013
σ0.087-0.075=0.012
min4.080-4.029=0.051
max4.516-4.505=0.010
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.671-7.668=0.003
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean4.209-4.198=0.011
σ0.077-0.073=0.004
min4.045-4.059=-0.014
max4.436-4.421=0.015
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.737-0.738=-0.002
σ0.022-0.019=0.002
min0.708-0.703=0.005
max0.852-0.870=-0.018
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.698-0.696=0.002
σ0.014-0.014=0.000
min0.669-0.671=-0.002
max0.768-0.781=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.560-295.480=0.080
σ0.238-0.259=-0.021
min295.418-295.322=0.095
max296.223-296.201=0.022
mean1910.000-2019.000=-109.000
σ0.000
min1910.000-2019.000=-109.000
max1910.000-2019.000=-109.000
mean0.567-0.532=0.036
σ0.060-0.039=0.021
min0.496-0.495=0.000
max0.696-0.598=0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.412=-0.002
σ0.038-0.043=-0.005
min285.359-285.354=0.005
max285.448-285.455=-0.007
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.386-0.388=-0.002
σ0.009-0.008=0.001
min0.382-0.380=0.002
max0.402-0.399=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.806=-0.013
σ0.109-0.112=-0.004
min1295.678-1295.677=0.001
max1295.923-1295.947=-0.024
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean1.914-1.876=0.037
σ0.091-0.086=0.005
min1.815-1.805=0.011
max2.019-2.018=0.001
iters=5
new-facts=6402
prior-facts=1
mean1539.933-1539.916=0.017
σ6.863-6.867=-0.004
min1536.577-1536.654=-0.078
max1552.203-1552.197=0.006
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean2.363-2.210=0.153
σ0.251-0.180=0.071
min2.065-2.037=0.028
max2.588-2.429=0.159
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.708=-0.006
σ0.053-0.055=-0.003
min1857.649-1857.649=-0.000
max1857.773-1857.776=-0.003
mean1777.400-1776.000=1.400
σ132.359-162.779=-30.420
min1638.000-1649.000=-11.000
max1910.000-2019.000=-109.000
mean3.112-3.028=0.084
σ0.253-0.332=-0.080
min2.855-2.828=0.027
max3.434-3.613=-0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.419-1.315=0.104
σ0.203-0.320=-0.117
min1.252-1.104=0.148
max1.697-1.872=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=-0.000
σ580.935-580.934=0.001
min155.270-155.272=-0.002
max1317.143-1317.142=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.532-0.526=0.006
σ0.549-0.529=0.020
min0.255-0.256=-0.001
max1.356-1.320=0.036
policies=20
mean1552.994-1552.986=0.007
σ0.331-0.323=0.008
min1552.769-1552.761=0.008
max1553.486-1553.465=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean2.588-2.586=0.002
σ0.018-0.018=-0.001
min2.567-2.568=-0.001
max2.608-2.604=0.004
policies=200
mean15538.064-15537.947=0.118
σ0.074-0.070=0.003
min15538.002-15537.875=0.127
max15538.166-15538.014=0.152
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean26.197-26.096=0.100
σ0.088-0.184=-0.096
min26.123-25.939=0.184
max26.317-26.363=-0.047