Compare commits

Home / Compare 7a4db3d8 .. 82e7e559

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.962-53.964=-0.002
σ0.368-0.371=-0.003
min53.817-53.821=-0.004
max55.009-55.019=-0.010
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.137-0.138=-0.001
σ0.005-0.004=0.001
min0.128-0.131=-0.003
max0.146-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.005-0.005=-0.001
min43.314-43.311=0.003
max43.333-43.333=0.000
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.121-0.120=0.001
σ0.005-0.001=0.003
min0.113-0.118=-0.006
max0.129-0.123=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.515-1006.510=0.006
σ1.164-1.190=-0.026
min1005.949-1005.975=-0.026
max1011.391-1011.490=-0.099
mean1050.450-1040.450=10.000
σ310.212-310.848=-0.637
min556.000-550.000=6.000
max1520.000-1509.000=11.000
mean1.525-1.548=-0.023
σ0.060-0.087=-0.027
min1.412-1.471=-0.059
max1.667-1.817=-0.151

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.002=0.000
min0.882
max0.887-0.887=0.000
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.430-0.432=-0.002
σ0.152-0.194=-0.042
min0.339-0.324=0.015
max0.699-0.778=-0.079
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.894-0.909=-0.015
σ0.131-0.184=-0.053
min0.816-0.804=0.012
max1.126-1.236=-0.111
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.535-0.533=0.001
σ0.041-0.057=-0.016
min0.508-0.495=0.013
max0.608-0.634=-0.026
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.853-0.835=0.018
σ0.044-0.037=0.007
min0.826-0.807=0.019
max0.930-0.898=0.032

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.829=0.002
σ0.021-0.031=-0.011
min964.812-964.806=0.006
max964.860-964.883=-0.023
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.824-0.811=0.013
σ0.031-0.043=-0.012
min0.776-0.742=0.034
max0.858-0.853=0.005
name=cdr_enhanced_4k_loc.art
mean885.510-885.510=0.000
σ0.008-0.008=0.000
min885.504
max885.522-885.522=0.000
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.722-0.649=0.072
σ0.028-0.042=-0.014
min0.675-0.604=0.070
max0.740-0.686=0.054

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean4.211-4.281=-0.070
σ0.102-0.092=0.011
min4.073-4.085=-0.012
max4.645-4.702=-0.056
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.670-7.670=0.001
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean4.180-4.288=-0.108
σ0.059-0.093=-0.034
min4.071-4.076=-0.005
max4.378-4.581=-0.203
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.737-0.752=-0.015
σ0.017-0.033=-0.017
min0.708-0.652=0.056
max0.841-0.837=0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.688-0.700=-0.012
σ0.018-0.014=0.004
min0.561-0.667=-0.107
max0.714-0.778=-0.063

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.434-296.470=-0.036
σ0.257-0.241=0.016
min296.219-296.194=0.026
max297.129-297.065=0.064
mean2019.000-2030.000=-11.000
σ0.000
min2019.000-2030.000=-11.000
max2019.000-2030.000=-11.000
mean0.594-0.542=0.052
σ0.006-0.035=-0.029
min0.581-0.500=0.081
max0.599-0.578=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.035-285.028=0.007
σ0.038-0.040=-0.001
min284.986-284.980=0.005
max285.079-285.068=0.011
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.397-0.383=0.014
σ0.012-0.027=-0.015
min0.385-0.338=0.046
max0.414-0.411=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.412-1295.406=0.005
σ0.112-0.106=0.006
min1295.290-1295.298=-0.008
max1295.548-1295.531=0.017
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean1.889-1.920=-0.031
σ0.102-0.127=-0.025
min1.797-1.816=-0.018
max2.024-2.078=-0.054
iters=5
new-facts=6402
prior-facts=1
mean1539.527-1539.526=0.001
σ6.856-6.819=0.037
min1536.233-1536.251=-0.017
max1551.786-1551.721=0.066
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean2.290-2.267=0.022
σ0.236-0.271=-0.035
min2.041-2.043=-0.003
max2.573-2.685=-0.112
iters=5
new-facts=6402
prior-facts=6402
mean1857.314-1857.322=-0.008
σ0.064-0.062=0.002
min1857.236-1857.251=-0.014
max1857.396-1857.394=0.002
mean1735.000-1737.600=-2.600
σ207.556-215.154=-7.598
min1520.000-1509.000=11.000
max2019.000-2030.000=-11.000
mean2.894-2.856=0.038
σ0.069-0.076=-0.006
min2.833-2.754=0.079
max2.970-2.936=0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.417-1.523=-0.106
σ0.331-0.213=0.118
min0.971-1.237=-0.266
max1.810-1.747=0.063

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.188=0.003
σ581.331-581.331=-0.000
min157.524-157.520=0.004
max1320.187-1320.185=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean0.549-0.554=-0.004
σ0.580-0.574=0.005
min0.259-0.262=-0.003
max1.419-1.415=0.004
policies=20
mean1575.571-1575.553=0.019
σ0.357-0.371=-0.014
min1575.332-1575.309=0.023
max1576.103-1576.106=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean2.634-2.656=-0.022
σ0.010-0.028=-0.018
min2.620-2.628=-0.008
max2.642-2.691=-0.049
policies=200
mean15763.663-15763.603=0.060
σ0.160-0.118=0.042
min15763.556-15763.519=0.037
max15763.899-15763.777=0.122
mean9200.000
σ0.000
min9200.000
max9200.000
mean1520.000-1509.000=11.000
σ0.000
min1520.000-1509.000=11.000
max1520.000-1509.000=11.000
mean26.465-26.546=-0.081
σ0.032-0.046=-0.014
min26.432-26.487=-0.055
max26.508-26.596=-0.088