Compare commits

Home / Compare 095ce0be .. 24d0e524

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.056=-0.011
σ0.369-0.370=-0.001
min53.892-53.908=-0.015
max55.096-55.109=-0.013
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.139-0.140=-0.002
σ0.004-0.004=-0.001
min0.135-0.137=-0.002
max0.145-0.149=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.385-43.394=-0.009
σ0.004-0.007=-0.004
min43.380-43.381=-0.001
max43.392-43.407=-0.015
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.121-0.124=-0.003
σ0.004-0.004=-0.000
min0.114-0.119=-0.005
max0.130-0.130=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.979=0.001
σ0.868-0.865=0.003
min1006.480-1006.479=0.001
max1010.569-1010.557=0.012
mean1047.100-1056.900=-9.800
σ315.079-321.885=-6.806
min577.000-579.000=-2.000
max1650.000-1638.000=12.000
mean1.557-1.534=0.023
σ0.062-0.090=-0.027
min1.500-1.443=0.057
max1.727-1.864=-0.137

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.437-0.414=0.023
σ0.191-0.117=0.074
min0.332-0.338=-0.006
max0.777-0.619=0.157
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.906-0.872=0.034
σ0.153-0.084=0.068
min0.822-0.814=0.008
max1.178-1.018=0.160
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.535-0.530=0.005
σ0.050-0.051=-0.001
min0.497-0.500=-0.003
max0.616-0.619=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.839-0.842=-0.003
σ0.036-0.020=0.017
min0.803-0.827=-0.024
max0.896-0.874=0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=0.001
σ0.025-0.024=0.000
min964.802
max964.861-964.861=0.001
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.823-0.772=0.051
σ0.031-0.049=-0.018
min0.786-0.723=0.063
max0.856-0.844=0.012
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.005-0.008=-0.002
min885.504
max885.516-885.522=-0.005
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.701-0.691=0.010
σ0.037-0.044=-0.006
min0.643-0.643=0.000
max0.743-0.745=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean3.480-4.209=-0.729
σ0.105-0.087=0.018
min3.327-4.080=-0.753
max4.158-4.516=-0.358
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.671=-0.003
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean3.779-4.209=-0.431
σ0.355-0.077=0.278
min3.310-4.045=-0.735
max4.323-4.436=-0.113
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.733-0.737=-0.004
σ0.019-0.022=-0.003
min0.697-0.708=-0.011
max0.849-0.852=-0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.693-0.698=-0.005
σ0.027-0.014=0.013
min0.521-0.669=-0.148
max0.793-0.768=0.025

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.693-295.560=0.133
σ0.248-0.238=0.011
min295.425-295.418=0.007
max296.351-296.223=0.127
mean1888.000-1910.000=-22.000
σ0.000
min1888.000-1910.000=-22.000
max1888.000-1910.000=-22.000
mean0.565-0.567=-0.002
σ0.045-0.060=-0.014
min0.497-0.496=0.002
max0.614-0.696=-0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.405-285.410=-0.005
σ0.041-0.038=0.003
min285.360-285.359=0.001
max285.452-285.448=0.004
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.384-0.386=-0.002
σ0.005-0.009=-0.004
min0.378-0.382=-0.003
max0.391-0.402=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.794=0.000
σ0.104-0.109=-0.004
min1295.681-1295.678=0.003
max1295.923-1295.923=0.000
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean1.923-1.914=0.010
σ0.102-0.091=0.011
min1.810-1.815=-0.005
max2.034-2.019=0.016
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.933=-0.018
σ6.854-6.863=-0.009
min1536.648-1536.577=0.072
max1552.173-1552.203=-0.030
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean2.231-2.363=-0.132
σ0.301-0.251=0.050
min1.930-2.065=-0.135
max2.685-2.588=0.097
iters=5
new-facts=6402
prior-facts=6402
mean1857.709-1857.702=0.007
σ0.054-0.053=0.002
min1857.648-1857.649=-0.001
max1857.778-1857.773=0.005
mean1771.000-1777.400=-6.400
σ118.030-132.359=-14.329
min1650.000-1638.000=12.000
max1888.000-1910.000=-22.000
mean2.995-3.112=-0.117
σ0.101-0.253=-0.151
min2.860-2.855=0.005
max3.101-3.434=-0.332

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.422-1.419=0.003
σ0.290-0.203=0.087
min1.110-1.252=-0.141
max1.815-1.697=0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.000
σ580.934-580.935=-0.001
min155.272-155.270=0.002
max1317.141-1317.143=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean0.525-0.532=-0.006
σ0.538-0.549=-0.012
min0.256-0.255=0.000
max1.332-1.356=-0.024
policies=20
mean1552.978-1552.994=-0.015
σ0.321-0.331=-0.010
min1552.755-1552.769=-0.014
max1553.455-1553.486=-0.031
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean2.579-2.588=-0.009
σ0.043-0.018=0.025
min2.551-2.567=-0.016
max2.641-2.608=0.033
policies=200
mean15537.863-15538.064=-0.201
σ0.133-0.074=0.059
min15537.773-15538.002=-0.229
max15538.060-15538.166=-0.106
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1638.000=12.000
σ0.000
min1650.000-1638.000=12.000
max1650.000-1638.000=12.000
mean26.074-26.197=-0.123
σ0.075-0.088=-0.014
min25.963-26.123=-0.160
max26.122-26.317=-0.194