Compare commits

Home / Compare 36d88c80 .. 6a8c5251

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.037-54.046=-0.008
σ0.368-0.369=-0.002
min53.891-53.892=-0.001
max55.083-55.096=-0.013
mean414.000
σ0.000
min414.000
max414.000
mean0.155-0.139=0.016
σ0.012-0.004=0.008
min0.138-0.135=0.003
max0.169-0.145=0.024
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.006-0.004=0.002
min43.376-43.380=-0.004
max43.395-43.392=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.123-0.121=0.002
σ0.005-0.004=0.001
min0.116-0.114=0.002
max0.132-0.130=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.979=-0.649
σ0.915-0.868=0.047
min1005.858-1006.480=-0.622
max1010.137-1010.569=-0.432
mean1048.600-1047.100=1.500
σ310.201-315.079=-4.878
min552.000-577.000=-25.000
max1642.000-1650.000=-8.000
mean1.569-1.557=0.012
σ0.117-0.062=0.054
min1.481-1.500=-0.018
max1.866-1.727=0.140

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.003=-0.001
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.421-0.437=-0.016
σ0.126-0.191=-0.064
min0.340-0.332=0.008
max0.644-0.777=-0.133
name=error_case.art
mean2.334-2.339=-0.004
σ0.003-0.003=-0.000
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.880-0.906=-0.027
σ0.080-0.153=-0.072
min0.829-0.822=0.007
max1.019-1.178=-0.158
name=heavy_item.art
mean1.521-1.524=-0.003
σ0.001-0.002=-0.001
min1.520-1.522=-0.002
max1.523-1.526=-0.003
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.537-0.535=0.001
σ0.053-0.050=0.004
min0.483-0.497=-0.014
max0.625-0.616=0.009
name=nested_use.art
mean2.356-2.361=-0.005
σ0.002-0.002=0.000
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.844-0.839=0.004
σ0.038-0.036=0.001
min0.800-0.803=-0.003
max0.901-0.896=0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-964.831=-1.280
σ0.025-0.025=0.001
min963.523-964.802=-1.279
max963.584-964.861=-1.277
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.845-0.823=0.022
σ0.015-0.031=-0.017
min0.819-0.786=0.033
max0.856-0.856=-0.000
name=cdr_enhanced_4k_loc.art
mean884.856-885.513=-0.656
σ0.007-0.005=0.002
min884.847-885.504=-0.657
max884.865-885.516=-0.651
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.739-0.701=0.038
σ0.008-0.037=-0.029
min0.730-0.643=0.087
max0.751-0.743=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=-0.000
min7.705-7.715=-0.010
max7.709-7.720=-0.011
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean4.254-3.480=0.773
σ0.081-0.105=-0.024
min4.116-3.327=0.789
max4.540-4.158=0.382
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean4.229-3.779=0.451
σ0.069-0.355=-0.286
min4.078-3.310=0.768
max4.446-4.323=0.123
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.746-0.733=0.013
σ0.018-0.019=-0.000
min0.715-0.697=0.019
max0.860-0.849=0.011
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002-0.002=-0.000
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.690-0.693=-0.003
σ0.069-0.027=0.042
min0.502-0.521=-0.019
max0.895-0.793=0.102

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.603-295.693=-0.090
σ0.242-0.248=-0.006
min295.430-295.425=0.005
max296.271-296.351=-0.080
mean1959.000-1888.000=71.000
σ0.000
min1959.000-1888.000=71.000
max1959.000-1888.000=71.000
mean0.585-0.565=0.020
σ0.016-0.045=-0.029
min0.549-0.497=0.052
max0.599-0.614=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.405=-0.155
σ0.042-0.041=0.001
min285.198-285.360=-0.162
max285.297-285.452=-0.154
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.400-0.384=0.016
σ0.011-0.005=0.006
min0.388-0.378=0.010
max0.411-0.391=0.020
iters=5
new-facts=1
prior-facts=6402
mean1295.192-1295.794=-0.602
σ0.108-0.104=0.004
min1295.067-1295.681=-0.613
max1295.327-1295.923=-0.597
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean1.934-1.923=0.011
σ0.058-0.102=-0.044
min1.855-1.810=0.045
max2.001-2.034=-0.033
iters=5
new-facts=6402
prior-facts=1
mean1538.085-1539.916=-1.830
σ4.041-6.854=-2.813
min1536.035-1536.648=-0.613
max1545.303-1552.173=-6.869
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean2.308-2.231=0.076
σ0.130-0.301=-0.171
min2.106-1.930=0.176
max2.438-2.685=-0.247
iters=5
new-facts=6402
prior-facts=6402
mean1857.125-1857.709=-0.584
σ0.083-0.054=0.028
min1857.023-1857.648=-0.624
max1857.223-1857.778=-0.554
mean1796.400-1771.000=25.400
σ158.765-118.030=40.735
min1642.000-1650.000=-8.000
max1959.000-1888.000=71.000
mean3.220-2.995=0.225
σ0.338-0.101=0.237
min2.895-2.860=0.035
max3.688-3.101=0.586

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.365-1.422=-0.057
σ0.248-0.290=-0.042
min1.107-1.110=-0.004
max1.764-1.815=-0.051

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-445.740=-2.132
σ577.066-580.934=-3.868
min155.073-155.272=-0.200
max1309.207-1317.141=-7.934
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean0.536-0.525=0.011
σ0.554-0.538=0.017
min0.258-0.256=0.003
max1.368-1.332=0.036
policies=20
mean1551.037-1552.978=-1.942
σ0.333-0.321=0.012
min1550.808-1552.755=-1.947
max1551.531-1553.455=-1.924
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean2.591-2.579=0.012
σ0.017-0.043=-0.025
min2.571-2.551=0.021
max2.611-2.641=-0.030
policies=200
mean15518.398-15537.863=-19.465
σ0.062-0.133=-0.070
min15518.341-15537.773=-19.431
max15518.463-15538.060=-19.597
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1650.000=-8.000
σ0.000
min1642.000-1650.000=-8.000
max1642.000-1650.000=-8.000
mean26.116-26.074=0.042
σ0.056-0.075=-0.019
min26.050-25.963=0.087
max26.175-26.122=0.053