Compare commits

Home / Compare 002fd40e .. 6c572a99

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-54.015=-0.050
σ0.368-0.369=-0.001
min53.822-53.873=-0.051
max55.012-55.065=-0.054
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.001
min0.131-0.136=-0.005
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.006=0.001
min43.313-43.314=-0.001
max43.336-43.334=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.118-0.122=-0.004
σ0.004-0.004=0.000
min0.114-0.118=-0.004
max0.125-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.516-1006.310=0.206
σ1.174-1.186=-0.012
min1005.948-1005.743=0.205
max1011.420-1011.273=0.146
mean1036.800-1046.750=-9.950
σ309.988-310.519=-0.530
min547.000-551.000=-4.000
max1503.000-1517.000=-14.000
mean1.545-1.552=-0.006
σ0.086-0.065=0.021
min1.452-1.495=-0.043
max1.801-1.772=0.028

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.414-0.409=0.005
σ0.138-0.142=-0.004
min0.338-0.313=0.025
max0.660-0.658=0.002
name=error_case.art
mean2.339-2.337=0.002
σ0.002-0.003=-0.000
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.887-0.887=0.001
σ0.105-0.097=0.008
min0.820-0.815=0.005
max1.071-1.056=0.015
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.531-0.544=-0.013
σ0.052-0.049=0.003
min0.492-0.507=-0.015
max0.619-0.626=-0.007
name=nested_use.art
mean2.361-2.360=0.001
σ0.002-0.002=-0.000
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.849-0.833=0.016
σ0.047-0.040=0.007
min0.819-0.788=0.031
max0.931-0.898=0.033

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.106=0.723
σ0.037-0.039=-0.002
min964.802-964.081=0.721
max964.894-964.174=0.720
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.851-0.820=0.031
σ0.011-0.024=-0.013
min0.833-0.793=0.040
max0.862-0.846=0.016
name=cdr_enhanced_4k_loc.art
mean885.510-884.709=0.801
σ0.006-0.005=0.001
min885.504-884.703=0.801
max885.517-884.717=0.801
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.717-0.731=-0.014
σ0.047-0.014=0.032
min0.635-0.706=-0.071
max0.744-0.740=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=-0.000
min7.715-7.714=0.002
max7.719-7.718=0.002
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean3.496-4.271=-0.775
σ0.073-0.093=-0.019
min3.348-4.097=-0.749
max3.775-4.550=-0.775
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean3.494-4.272=-0.779
σ0.069-0.100=-0.031
min3.352-4.136=-0.784
max3.683-4.706=-1.023
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.734-0.737=-0.003
σ0.016-0.026=-0.010
min0.702-0.697=0.005
max0.824-0.906=-0.082
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.697-0.695=0.002
σ0.022-0.014=0.008
min0.542-0.666=-0.124
max0.785-0.772=0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.235-296.149=0.086
σ0.206-0.219=-0.013
min296.117-295.970=0.147
max296.805-296.732=0.073
mean1945.000-1902.000=43.000
σ0.000
min1945.000-1902.000=43.000
max1945.000-1902.000=43.000
mean0.573-0.586=-0.012
σ0.028-0.026=0.002
min0.522-0.545=-0.022
max0.602-0.645=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.034-284.692=0.342
σ0.034-0.035=-0.001
min284.988-284.653=0.335
max285.071-284.732=0.338
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.393-0.398=-0.004
σ0.007-0.009=-0.003
min0.385-0.387=-0.001
max0.401-0.407=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.421-1295.063=0.358
σ0.111-0.087=0.023
min1295.287-1294.960=0.327
max1295.531-1295.164=0.367
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean1.986-1.918=0.068
σ0.105-0.102=0.003
min1.885-1.804=0.081
max2.156-2.042=0.115
iters=5
new-facts=6402
prior-facts=1
mean1539.512-1539.182=0.330
σ6.854-6.861=-0.007
min1536.213-1535.935=0.277
max1551.768-1551.452=0.316
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean2.233-2.243=-0.010
σ0.213-0.275=-0.062
min2.057-1.952=0.105
max2.582-2.540=0.042
iters=5
new-facts=6402
prior-facts=6402
mean1857.325-1856.988=0.337
σ0.066-0.059=0.007
min1857.261-1856.930=0.330
max1857.416-1857.073=0.342
mean1748.800-1745.400=3.400
σ158.823-166.644=-7.821
min1509.000-1517.000=-8.000
max1945.000-1902.000=43.000
mean2.863-3.052=-0.188
σ0.153-0.257=-0.104
min2.636-2.854=-0.218
max3.059-3.490=-0.431

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.597-1.563=0.034
σ0.375-0.311=0.064
min0.953-1.189=-0.236
max1.852-1.823=0.029

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.190-447.786=0.404
σ581.332-581.213=0.119
min157.522-157.178=0.344
max1320.187-1319.605=0.582
mean96.250
σ8.500
min92.000
max109.000
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean0.540-0.554=-0.014
σ0.552-0.589=-0.037
min0.260-0.258=0.001
max1.368-1.437=-0.069
policies=20
mean1575.556-1572.105=3.451
σ0.358-0.356=0.003
min1575.316-1571.862=3.454
max1576.089-1572.634=3.456
mean920.000
σ0.000
min920.000
max920.000
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean2.643-2.635=0.008
σ0.017-0.012=0.005
min2.626-2.620=0.005
max2.659-2.650=0.010
policies=200
mean15763.732-15728.982=34.750
σ0.142-0.146=-0.004
min15763.548-15728.877=34.671
max15763.893-15729.195=34.698
mean9200.000
σ0.000
min9200.000
max9200.000
mean1503.000-1517.000=-14.000
σ0.000
min1503.000-1517.000=-14.000
max1503.000-1517.000=-14.000
mean26.493-26.516=-0.023
σ0.034-0.038=-0.005
min26.452-26.469=-0.017
max26.534-26.550=-0.016