Compare commits

Home / Compare dcf2ed8b .. 2bc35bcc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.370-0.370=0.000
min53.870-53.876=-0.006
max55.067-55.067=0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.138=0.002
σ0.005-0.004=0.001
min0.134-0.132=0.001
max0.150-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.006-0.007=-0.001
min43.311-43.309=0.002
max43.335-43.331=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.119=0.002
σ0.003-0.005=-0.003
min0.119-0.112=0.006
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.307=0.001
σ1.194-1.167=0.027
min1005.777-1005.753=0.024
max1011.313-1011.189=0.125
mean1052.200-1051.800=0.400
σ307.208-305.046=2.163
min585.000-597.000=-12.000
max1644.000-1646.000=-2.000
mean1.565-1.559=0.006
σ0.085-0.066=0.019
min1.490-1.481=0.009
max1.789-1.688=0.100

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866-0.866=-0.000
σ0.003-0.002=0.000
min0.864
max0.869
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.413-0.428=-0.015
σ0.138-0.183=-0.045
min0.332-0.332=0.000
max0.659-0.755=-0.096
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.881-0.913=-0.032
σ0.101-0.187=-0.086
min0.821-0.801=0.019
max1.060-1.245=-0.185
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.529-0.537=-0.007
σ0.046-0.050=-0.004
min0.490-0.487=0.003
max0.606-0.617=-0.011
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.828-0.841=-0.013
σ0.035-0.043=-0.008
min0.783-0.801=-0.018
max0.878-0.906=-0.027

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.113=0.002
σ0.033-0.019=0.014
min964.088-964.095=-0.008
max964.169-964.143=0.027
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.846-0.830=0.017
σ0.003-0.029=-0.026
min0.843-0.797=0.046
max0.852-0.853=-0.001
name=cdr_enhanced_4k_loc.art
mean884.712-884.713=-0.002
σ0.008-0.001=0.007
min884.703-884.712=-0.009
max884.723-884.714=0.009
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.682-0.698=-0.016
σ0.040-0.051=-0.011
min0.627-0.634=-0.007
max0.726-0.741=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean3.476-4.284=-0.808
σ0.078-0.089=-0.012
min3.370-4.142=-0.772
max3.760-4.575=-0.815
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean4.112-4.250=-0.138
σ0.303-0.072=0.232
min3.401-4.128=-0.727
max4.985-4.505=0.480
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.730-0.736=-0.006
σ0.016-0.021=-0.005
min0.705-0.707=-0.002
max0.811-0.849=-0.038
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.692-0.693=-0.001
σ0.013-0.014=-0.001
min0.665-0.668=-0.003
max0.740-0.772=-0.032

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.286-296.147=0.139
σ0.232-0.217=0.014
min296.106-296.019=0.088
max296.915-296.719=0.195
mean1907.000-1909.000=-2.000
σ0.000
min1907.000-1909.000=-2.000
max1907.000-1909.000=-2.000
mean0.583-0.580=0.002
σ0.044-0.052=-0.008
min0.538-0.513=0.025
max0.690-0.701=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.692=0.000
σ0.039-0.037=0.002
min284.641-284.645=-0.004
max284.734-284.730=0.005
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.398-0.394=0.003
σ0.010-0.010=-0.000
min0.386-0.382=0.003
max0.406-0.402=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.087=-0.007
σ0.107-0.118=-0.010
min1294.961-1294.960=0.001
max1295.208-1295.238=-0.031
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean1.901-1.874=0.027
σ0.097-0.069=0.027
min1.806-1.821=-0.015
max2.030-1.992=0.038
iters=5
new-facts=6402
prior-facts=1
mean1539.222-1539.193=0.029
σ6.838-6.822=0.016
min1535.923-1535.947=-0.024
max1551.448-1551.393=0.055
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean2.357-2.291=0.067
σ0.177-0.262=-0.086
min2.051-2.015=0.037
max2.459-2.658=-0.199
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.988=-0.002
σ0.053-0.057=-0.004
min1856.940-1856.927=0.013
max1857.070-1857.073=-0.003
mean1776.600-1776.200=0.400
σ129.782-129.953=-0.171
min1644.000-1646.000=-2.000
max1907.000-1909.000=-2.000
mean3.037-3.091=-0.055
σ0.296-0.362=-0.066
min2.778-2.834=-0.056
max3.532-3.727=-0.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.176-1.116=0.060
σ0.312-0.218=0.094
min0.940-0.935=0.005
max1.685-1.426=0.259

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.784=0.001
σ581.213-581.212=0.000
min157.176-157.174=0.002
max1319.604-1319.602=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean0.548-0.532=0.016
σ0.570-0.546=0.025
min0.261-0.258=0.003
max1.404-1.351=0.053
policies=20
mean1572.086-1572.082=0.004
σ0.354-0.343=0.011
min1571.846-1571.849=-0.003
max1572.613-1572.592=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean2.628-2.607=0.021
σ0.022-0.002=0.020
min2.607-2.604=0.003
max2.651-2.609=0.042
policies=200
mean15729.010-15728.998=0.011
σ0.092-0.054=0.037
min15728.874-15728.929=-0.055
max15729.066-15729.042=0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1646.000=-2.000
σ0.000
min1644.000-1646.000=-2.000
max1644.000-1646.000=-2.000
mean26.548-26.526=0.023
σ0.088-0.104=-0.016
min26.487-26.435=0.053
max26.677-26.673=0.005