Compare commits

Home / Compare 28ec592b .. 92d60846

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-54.015=-0.051
σ0.370-0.371=-0.001
min53.818-53.868=-0.050
max55.015-55.069=-0.054
mean414.000-415.700=-1.700
σ0.000-0.483=-0.483
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.135-0.137=-0.003
σ0.005-0.006=-0.000
min0.129-0.129=-0.000
max0.144-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.005-0.005=-0.000
min43.316-43.315=0.001
max43.334-43.330=0.004
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.122-0.122=0.000
σ0.003-0.004=-0.001
min0.118-0.118=0.001
max0.127-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.312=0.202
σ1.175-1.164=0.011
min1005.952-1005.744=0.209
max1011.432-1011.181=0.250
mean1049.400-1049.350=0.050
σ312.677-303.784=8.893
min550.000-597.000=-47.000
max1514.000-1640.000=-126.000
mean1.532-1.556=-0.023
σ0.077-0.091=-0.014
min1.414-1.454=-0.040
max1.777-1.837=-0.060

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.428-0.414=0.014
σ0.177-0.166=0.011
min0.335-0.311=0.024
max0.743-0.706=0.037
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.902-0.924=-0.022
σ0.150-0.164=-0.014
min0.818-0.831=-0.013
max1.169-1.217=-0.048
name=heavy_item.art
mean1.524-1.523=0.000
σ0.002-0.002=0.000
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.531-0.534=-0.002
σ0.055-0.049=0.006
min0.496-0.489=0.006
max0.627-0.613=0.014
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.003=-0.001
min2.360-2.359=0.001
max2.364-2.365=-0.001
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.838-0.844=-0.006
σ0.035-0.033=0.001
min0.812-0.816=-0.004
max0.896-0.897=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.112=0.720
σ0.021-0.022=-0.001
min964.811-964.090=0.721
max964.860-964.145=0.714
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.807-0.810=-0.003
σ0.040-0.043=-0.004
min0.741-0.739=0.003
max0.848-0.850=-0.001
name=cdr_enhanced_4k_loc.art
mean885.510-884.713=0.797
σ0.007-0.001=0.007
min885.504-884.712=0.792
max885.521-884.714=0.807
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.701-0.708=-0.007
σ0.042-0.036=0.006
min0.633-0.666=-0.033
max0.736-0.739=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002
min7.715-7.714=0.002
max7.721-7.719=0.002
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean4.218-4.277=-0.059
σ0.073-0.090=-0.017
min4.115-4.134=-0.019
max4.621-4.695=-0.074
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=0.000
min7.664-7.662=0.002
max7.669-7.666=0.003
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean4.215-4.246=-0.031
σ0.067-0.071=-0.005
min4.073-4.133=-0.061
max4.424-4.539=-0.115
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.751-0.732=0.018
σ0.018-0.017=0.001
min0.712-0.705=0.007
max0.862-0.834=0.028
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.708-0.691=0.016
σ0.015-0.017=-0.002
min0.675-0.649=0.025
max0.795-0.780=0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.383-296.193=0.190
σ0.269-0.190=0.079
min296.122-296.010=0.112
max297.100-296.705=0.396
mean1913.000-1906.000=7.000
σ0.000
min1913.000-1906.000=7.000
max1913.000-1906.000=7.000
mean0.575-0.594=-0.020
σ0.037-0.035=0.003
min0.484-0.550=-0.066
max0.610-0.680=-0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.032-284.693=0.340
σ0.037-0.038=-0.001
min284.980-284.642=0.338
max285.066-284.736=0.330
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.396-0.395=0.000
σ0.008-0.011=-0.003
min0.388-0.383=0.005
max0.407-0.407=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.074=0.337
σ0.113-0.109=0.004
min1295.286-1294.963=0.323
max1295.543-1295.207=0.335
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean1.907-1.915=-0.008
σ0.057-0.100=-0.043
min1.850-1.798=0.052
max1.968-2.020=-0.052
iters=5
new-facts=6402
prior-facts=1
mean1539.530-1539.186=0.343
σ6.811-6.840=-0.029
min1536.235-1535.924=0.311
max1551.709-1551.419=0.290
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean2.282-2.240=0.042
σ0.221-0.263=-0.042
min2.065-2.040=0.025
max2.635-2.666=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean1857.318-1856.980=0.338
σ0.077-0.063=0.014
min1857.221-1856.907=0.314
max1857.411-1857.069=0.341
mean1753.800-1773.200=-19.400
σ173.884-130.433=43.451
min1514.000-1640.000=-126.000
max1913.000-1906.000=7.000
mean3.058-3.061=-0.003
σ0.250-0.289=-0.038
min2.798-2.851=-0.053
max3.426-3.566=-0.140

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.427-1.137=0.290
σ0.338-0.254=0.084
min0.965-0.936=0.029
max1.719-1.526=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-447.785=0.406
σ581.331-581.212=0.119
min157.524-157.177=0.346
max1320.188-1319.603=0.585
mean96.250
σ8.500
min92.000
max109.000
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean0.556-0.535=0.021
σ0.590-0.549=0.041
min0.259-0.258=0.000
max1.441-1.359=0.082
policies=20
mean1575.568-1572.103=3.465
σ0.347-0.355=-0.007
min1575.332-1571.867=3.465
max1576.084-1572.631=3.454
mean920.000
σ0.000
min920.000
max920.000
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean2.619-2.629=-0.009
σ0.015-0.024=-0.009
min2.606-2.607=-0.000
max2.636-2.655=-0.019
policies=200
mean15763.638-15728.972=34.666
σ0.083-0.076=0.006
min15763.551-15728.902=34.649
max15763.719-15729.050=34.669
mean9200.000
σ0.000
min9200.000
max9200.000
mean1514.000-1640.000=-126.000
σ0.000
min1514.000-1640.000=-126.000
max1514.000-1640.000=-126.000
mean26.476-26.535=-0.059
σ0.040-0.082=-0.042
min26.442-26.470=-0.028
max26.515-26.654=-0.139