Compare commits

Home / Compare 69deed61 .. d40244ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.703=0.000
σ0.370-0.368=0.001
min53.557-53.557=-0.000
max54.755-54.750=0.004
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.136-0.138=-0.001
σ0.003-0.004=-0.001
min0.131-0.130=0.001
max0.142-0.144=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.059-43.059=0.000
σ0.006-0.006=-0.000
min43.051-43.052=-0.000
max43.068-43.068=0.000
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.122-0.121=0.002
σ0.004-0.005=-0.002
min0.119-0.113=0.006
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.108-1005.109=-0.001
σ0.881-0.875=0.007
min1004.638-1004.631=0.007
max1008.755-1008.728=0.027
mean1049.850-1058.750=-8.900
σ315.078-322.280=-7.201
min594.000-557.000=37.000
max1653.000-1629.000=24.000
mean1.622-1.632=-0.010
σ0.078-0.087=-0.009
min1.510-1.550=-0.040
max1.868-1.873=-0.005

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.415-0.409=0.005
σ0.139-0.120=0.019
min0.333-0.332=0.001
max0.662-0.621=0.041
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.869-0.880=-0.012
σ0.090-0.086=0.003
min0.788-0.829=-0.042
max1.021-1.033=-0.012
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.536-0.538=-0.001
σ0.047-0.048=-0.000
min0.491-0.494=-0.003
max0.611-0.614=-0.003
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.834-0.833=0.001
σ0.051-0.036=0.015
min0.782-0.802=-0.020
max0.919-0.894=0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.553=0.000
σ0.025-0.025=0.000
min963.523
max963.583-963.584=-0.001
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.834-0.816=0.018
σ0.039-0.033=0.005
min0.774-0.764=0.010
max0.867-0.855=0.012
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=-0.000
σ0.006-0.006=-0.000
min884.847
max884.861-884.863=-0.002
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.699-0.724=-0.025
σ0.046-0.036=0.010
min0.634-0.660=-0.026
max0.745-0.744=0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.713=-0.002
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean3.536-4.226=-0.689
σ0.192-0.085=0.107
min3.363-4.107=-0.744
max4.307-4.565=-0.259
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.659-7.658=0.001
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean4.206-4.202=0.004
σ0.063-0.064=-0.001
min4.106-4.088=0.018
max4.437-4.410=0.027
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.735-0.736=-0.001
σ0.017-0.020=-0.002
min0.702-0.693=0.009
max0.842-0.854=-0.012
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.696-0.693=0.003
σ0.014-0.033=-0.019
min0.671-0.506=0.164
max0.760-0.763=-0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.165-294.261=-0.097
σ0.236-0.278=-0.042
min293.984-294.044=-0.060
max294.814-294.993=-0.179
mean1901.000-2034.000=-133.000
σ0.000
min1901.000-2034.000=-133.000
max1901.000-2034.000=-133.000
mean0.580-0.554=0.026
σ0.042-0.039=0.003
min0.524-0.505=0.020
max0.651-0.598=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.492-281.495=-0.002
σ0.037-0.040=-0.003
min281.439-281.440=-0.001
max281.528-281.536=-0.007
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.394-0.385=0.009
σ0.011-0.007=0.005
min0.385-0.378=0.007
max0.411-0.392=0.018
iters=5
new-facts=1
prior-facts=6402
mean1291.477-1291.453=0.024
σ0.104-0.099=0.005
min1291.352-1291.367=-0.015
max1291.591-1291.618=-0.027
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean1.877-1.930=-0.052
σ0.060-0.149=-0.089
min1.816-1.807=0.009
max1.940-2.149=-0.209
iters=5
new-facts=6402
prior-facts=1
mean1534.359-1534.374=-0.016
σ4.030-3.962=0.068
min1532.363-1532.464=-0.101
max1541.559-1541.457=0.102
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean2.399-2.308=0.091
σ0.219-0.211=0.008
min2.146-2.110=0.036
max2.622-2.624=-0.002
iters=5
new-facts=6402
prior-facts=6402
mean1853.357-1853.356=0.002
σ0.053-0.053=0.000
min1853.302-1853.305=-0.003
max1853.436-1853.420=0.016
mean1784.000-1784.600=-0.600
σ120.058-177.125=-57.067
min1653.000-1629.000=24.000
max1901.000-2034.000=-133.000
mean3.067-2.982=0.085
σ0.241-0.379=-0.137
min2.830-2.686=0.143
max3.451-3.641=-0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.372-1.368=0.004
σ0.227-0.238=-0.011
min1.114-1.108=0.006
max1.690-1.738=-0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.429=0.000
σ577.065-577.065=0.000
min153.894-153.893=0.001
max1308.026-1308.026=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean0.529-0.528=0.001
σ0.540-0.550=-0.010
min0.257-0.241=0.016
max1.339-1.353=-0.014
policies=20
mean1539.222-1539.231=-0.009
σ0.316-0.330=-0.015
min1539.004-1539.003=0.001
max1539.690-1539.721=-0.031
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean2.581-2.596=-0.015
σ0.016-0.048=-0.032
min2.561-2.557=0.003
max2.599-2.666=-0.067
policies=200
mean15400.469-15400.453=0.016
σ0.099-0.092=0.006
min15400.408-15400.390=0.018
max15400.617-15400.590=0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1629.000=24.000
σ0.000
min1653.000-1629.000=24.000
max1653.000-1629.000=24.000
mean26.172-26.138=0.034
σ0.227-0.122=0.105
min25.954-26.042=-0.088
max26.409-26.296=0.114