Compare commits

Home / Compare a5c5c947 .. f0546267

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-54.056=-0.351
σ0.367-0.368=-0.001
min53.565-53.914=-0.349
max54.751-55.104=-0.353
mean416.700-417.000=-0.300
σ0.483-0.000=0.483
min416.000-417.000=-1.000
max417.000
mean0.140-0.137=0.002
σ0.003-0.006=-0.002
min0.136-0.130=0.007
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.059-43.396=-0.337
σ0.006-0.006=0.000
min43.048-43.386=-0.338
max43.067-43.406=-0.339
mean417.000
σ0.000
min417.000
max417.000
mean0.123-0.125=-0.002
σ0.004-0.005=-0.001
min0.118-0.120=-0.001
max0.129-0.135=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1006.961=-1.856
σ0.888-0.867=0.021
min1004.637-1006.462=-1.825
max1008.782-1010.547=-1.766
mean1055.100-1048.750=6.350
σ321.597-318.009=3.588
min553.000-546.000=7.000
max1632.000-1650.000=-18.000
mean1.628-1.538=0.091
σ0.090-0.095=-0.005
min1.556-1.384=0.171
max1.879-1.785=0.094

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.418-0.424=-0.007
σ0.135-0.142=-0.007
min0.335-0.339=-0.004
max0.658-0.677=-0.019
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.878-0.912=-0.035
σ0.086-0.097=-0.011
min0.830-0.848=-0.018
max1.031-1.083=-0.053
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.542-0.540=0.001
σ0.057-0.050=0.006
min0.485-0.512=-0.027
max0.636-0.630=0.006
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.840-0.863=-0.023
σ0.039-0.036=0.004
min0.808-0.838=-0.030
max0.904-0.925=-0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-964.839=-1.285
σ0.026-0.034=-0.008
min963.535-964.810=-1.275
max963.599-964.894=-1.295
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.827-0.807=0.020
σ0.039-0.051=-0.012
min0.773-0.739=0.034
max0.860-0.854=0.007
name=cdr_enhanced_4k_loc.art
mean884.853-885.511=-0.658
σ0.008-0.007=0.001
min884.847-885.505=-0.659
max884.866-885.522=-0.656
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.713-0.690=0.023
σ0.065-0.045=0.020
min0.596-0.635=-0.039
max0.746-0.735=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.712-7.719=-0.007
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean4.266-4.238=0.028
σ0.067-0.099=-0.032
min4.148-3.803=0.345
max4.538-4.552=-0.014
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002-0.002=-0.000
min7.654-7.664=-0.010
max7.658-7.669=-0.011
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean4.265-4.220=0.045
σ0.069-0.063=0.006
min4.144-4.117=0.028
max4.636-4.468=0.168
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.745-0.751=-0.005
σ0.016-0.018=-0.002
min0.717-0.723=-0.005
max0.863-0.868=-0.005
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.703-0.712=-0.009
σ0.016-0.015=0.001
min0.678-0.686=-0.009
max0.803-0.786=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.342-295.492=-1.149
σ0.279-0.264=0.015
min294.065-295.244=-1.180
max295.075-296.175=-1.100
mean1974.000-2018.000=-44.000
σ0.000
min1974.000-2018.000=-44.000
max1974.000-2018.000=-44.000
mean0.570-0.550=0.020
σ0.067-0.041=0.027
min0.495-0.502=-0.007
max0.717-0.598=0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-285.390=-3.897
σ0.036-0.034=0.002
min281.453-285.342=-3.889
max281.529-285.424=-3.895
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.379-0.391=-0.012
σ0.001-0.005=-0.005
min0.378-0.383=-0.005
max0.380-0.396=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1291.479-1295.759=-4.280
σ0.117-0.086=0.030
min1291.352-1295.656=-4.304
max1291.646-1295.870=-4.224
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean1.928-1.847=0.082
σ0.109-0.056=0.053
min1.788-1.799=-0.011
max2.046-1.921=0.124
iters=5
new-facts=6402
prior-facts=1
mean1534.344-1539.896=-5.552
σ4.031-6.858=-2.827
min1532.322-1536.598=-4.276
max1541.543-1552.158=-10.615
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean2.349-2.289=0.060
σ0.263-0.182=0.081
min2.093-2.135=-0.042
max2.705-2.589=0.116
iters=5
new-facts=6402
prior-facts=6402
mean1853.374-1857.688=-4.314
σ0.078-0.067=0.010
min1853.284-1857.610=-4.326
max1853.469-1857.775=-4.306
mean1802.800-1767.200=35.600
σ168.869-156.516=12.353
min1632.000-1650.000=-18.000
max1974.000-2018.000=-44.000
mean3.253-2.913=0.340
σ0.334-0.063=0.271
min2.892-2.838=0.054
max3.656-2.977=0.679

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.424-1.224=0.201
σ0.305-0.328=-0.024
min1.102-0.946=0.155
max1.873-1.776=0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-445.708=-3.279
σ577.063-580.934=-3.870
min153.895-155.239=-1.345
max1308.024-1317.108=-9.084
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean0.521-0.551=-0.031
σ0.515-0.576=-0.062
min0.261-0.259=0.002
max1.293-1.416=-0.123
policies=20
mean1539.224-1552.659=-13.434
σ0.321-0.327=-0.006
min1538.999-1552.431=-13.432
max1539.700-1553.144=-13.444
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean2.573-2.591=-0.018
σ0.016-0.001=0.015
min2.554-2.590=-0.036
max2.589-2.592=-0.003
policies=200
mean15400.365-15534.652=-134.287
σ0.085-0.196=-0.111
min15400.270-15534.529=-134.258
max15400.467-15534.944=-134.477
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1650.000=-18.000
σ0.000
min1632.000-1650.000=-18.000
max1632.000-1650.000=-18.000
mean25.961-26.245=-0.284
σ0.075-0.114=-0.039
min25.862-26.144=-0.282
max26.035-26.384=-0.350