Compare commits

Home / Compare c0a68aa7 .. c5f2b7cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.045=-0.014
σ0.369-0.368=0.001
min53.888-53.901=-0.012
max55.081-55.092=-0.012
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.140-0.139=0.001
σ0.004-0.004=-0.000
min0.136-0.133=0.004
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.007-0.006=0.001
min43.374-43.376=-0.002
max43.399-43.395=0.004
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.123-0.124=-0.001
σ0.004-0.004=-0.001
min0.118-0.118=-0.000
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.980=-0.652
σ0.844-0.871=-0.026
min1005.837-1006.509=-0.671
max1009.816-1010.582=-0.766
mean1054.300-1052.600=1.700
σ308.413-319.974=-11.561
min558.000-576.000=-18.000
max1654.000-1619.000=35.000
mean1.558-1.560=-0.002
σ0.079-0.124=-0.045
min1.465-1.468=-0.003
max1.778-2.047=-0.270

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.434-0.428=0.005
σ0.133-0.139=-0.006
min0.343-0.330=0.013
max0.666-0.663=0.002
name=error_case.art
mean2.334-2.339=-0.004
σ0.002-0.003=-0.001
min2.333-2.337=-0.004
max2.337-2.342=-0.005
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.906-0.858=0.048
σ0.098-0.085=0.013
min0.852-0.800=0.052
max1.081-1.003=0.077
name=heavy_item.art
mean1.522-1.524=-0.002
σ0.002-0.002=0.000
min1.520-1.522=-0.002
max1.525-1.526=-0.001
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.554-0.531=0.023
σ0.044-0.046=-0.002
min0.513-0.499=0.014
max0.627-0.610=0.017
name=nested_use.art
mean2.356-2.361=-0.005
σ0.002-0.002=0.001
min2.355-2.360=-0.005
max2.360-2.364=-0.004
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.859-0.831=0.027
σ0.034-0.048=-0.015
min0.833-0.793=0.040
max0.915-0.909=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.836=-1.284
σ0.025-0.035=-0.010
min963.523-964.811=-1.288
max963.585-964.897=-1.312
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.822-0.826=-0.004
σ0.030-0.019=0.011
min0.773-0.801=-0.027
max0.854-0.845=0.010
name=cdr_enhanced_4k_loc.art
mean884.856-885.512=-0.657
σ0.005-0.005=0.000
min884.847-885.504=-0.657
max884.860-885.517=-0.656
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.732-0.704=0.028
σ0.025-0.051=-0.026
min0.687-0.615=0.072
max0.746-0.735=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=-0.000
min7.705-7.715=-0.010
max7.709-7.720=-0.011
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean4.227-4.230=-0.003
σ0.083-0.091=-0.007
min4.080-4.098=-0.018
max4.523-4.579=-0.057
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean4.212-4.195=0.018
σ0.080-0.084=-0.003
min4.074-4.054=0.020
max4.599-4.508=0.092
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.749-0.729=0.019
σ0.017-0.035=-0.018
min0.716-0.520=0.196
max0.848-0.841=0.007
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.696-0.694=0.002
σ0.015-0.029=-0.013
min0.666-0.659=0.007
max0.779-0.894=-0.115

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.747-295.619=0.128
σ0.237-0.229=0.009
min295.546-295.361=0.184
max296.392-296.200=0.191
mean1898.000-1921.000=-23.000
σ0.000
min1898.000-1921.000=-23.000
max1898.000-1921.000=-23.000
mean0.577-0.591=-0.014
σ0.068-0.022=0.046
min0.506-0.573=-0.068
max0.730-0.645=0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.239-285.406=-0.168
σ0.039-0.038=0.001
min285.189-285.351=-0.162
max285.279-285.442=-0.164
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.390-0.383=0.007
σ0.010-0.005=0.005
min0.383-0.379=0.003
max0.402-0.392=0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.170-1295.796=-0.625
σ0.111-0.122=-0.012
min1295.080-1295.638=-0.558
max1295.353-1295.981=-0.628
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean1.976-2.033=-0.056
σ0.189-0.262=-0.073
min1.803-1.788=0.015
max2.254-2.313=-0.060
iters=5
new-facts=6402
prior-facts=1
mean1538.127-1539.915=-1.789
σ3.984-6.838=-2.854
min1536.201-1536.657=-0.456
max1545.249-1552.144=-6.895
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean2.296-2.173=0.124
σ0.199-0.096=0.103
min2.090-2.087=0.003
max2.538-2.311=0.226
iters=5
new-facts=6402
prior-facts=6402
mean1857.105-1857.706=-0.601
σ0.054-0.056=-0.002
min1857.052-1857.646=-0.595
max1857.178-1857.769=-0.591
mean1771.200-1770.800=0.400
σ120.825-147.493=-26.668
min1654.000-1619.000=35.000
max1898.000-1921.000=-23.000
mean3.033-2.997=0.036
σ0.177-0.092=0.085
min2.859-2.884=-0.025
max3.328-3.093=0.235

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.352-1.289=0.063
σ0.216-0.284=-0.068
min1.111-0.991=0.120
max1.696-1.732=-0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.607-445.741=-2.134
σ577.066-580.934=-3.869
min155.071-155.272=-0.201
max1309.206-1317.142=-7.936
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean0.522-0.553=-0.030
σ0.530-0.589=-0.059
min0.253-0.257=-0.003
max1.317-1.435=-0.118
policies=20
mean1551.017-1552.986=-1.969
σ0.331-0.340=-0.010
min1550.789-1552.756=-1.967
max1551.507-1553.492=-1.985
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean2.584-2.620=-0.036
σ0.023-0.078=-0.055
min2.554-2.571=-0.017
max2.610-2.734=-0.124
policies=200
mean15518.420-15537.989=-19.569
σ0.135-0.116=0.019
min15518.278-15537.839=-19.561
max15518.602-15538.096=-19.494
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1619.000=35.000
σ0.000
min1654.000-1619.000=35.000
max1654.000-1619.000=35.000
mean26.200-26.066=0.134
σ0.138-0.189=-0.051
min26.091-25.929=0.162
max26.380-26.337=0.043