Compare commits

Home / Compare 09cc348b .. dc0d6fe3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-54.056=-0.351
σ0.365-0.369=-0.003
min53.565-53.922=-0.358
max54.744-55.106=-0.362
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.137-0.141=-0.004
σ0.005-0.007=-0.002
min0.130-0.133=-0.003
max0.146-0.156=-0.011
cache=y
dps=1
iters=10
policies=100
mean43.059-43.394=-0.335
σ0.007-0.006=0.001
min43.049-43.385=-0.335
max43.069-43.401=-0.332
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.121-0.122=-0.001
σ0.004-0.003=0.000
min0.118-0.119=-0.000
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.104-1006.980=-1.876
σ0.894-0.870=0.024
min1004.640-1006.481=-1.841
max1008.809-1010.582=-1.773
mean1050.200-1048.250=1.950
σ315.471-311.486=3.985
min593.000-577.000=16.000
max1653.000-1650.000=3.000
mean1.617-1.542=0.076
σ0.106-0.096=0.010
min1.450-1.460=-0.010
max1.895-1.791=0.105

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.884=-0.002
σ0.002-0.002=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.448-0.445=0.003
σ0.127-0.181=-0.055
min0.368-0.346=0.022
max0.671-0.767=-0.096
name=error_case.art
mean2.334-2.339=-0.004
σ0.003-0.003=-0.000
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.909-0.921=-0.013
σ0.095-0.155=-0.060
min0.834-0.830=0.004
max1.072-1.197=-0.125
name=heavy_item.art
mean1.521-1.524=-0.003
σ0.001-0.002=-0.001
min1.520-1.522=-0.002
max1.523-1.526=-0.003
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.546-0.529=0.017
σ0.057-0.046=0.011
min0.492-0.494=-0.002
max0.637-0.607=0.030
name=nested_use.art
mean2.356-2.361=-0.005
σ0.002-0.002=0.000
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.877-0.839=0.038
σ0.066-0.038=0.028
min0.808-0.802=0.005
max0.963-0.902=0.061

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.835=-1.283
σ0.025-0.030=-0.005
min963.524-964.811=-1.287
max963.584-964.886=-1.302
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.835-0.785=0.050
σ0.030-0.058=-0.029
min0.797-0.708=0.089
max0.865-0.864=0.001
name=cdr_enhanced_4k_loc.art
mean884.857-885.514=-0.657
σ0.007-0.009=-0.001
min884.847-885.504=-0.657
max884.866-885.525=-0.659
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.737-0.710=0.028
σ0.021-0.064=-0.043
min0.705-0.598=0.107
max0.758-0.755=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.711-7.719=-0.009
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean4.321-4.224=0.097
σ0.080-0.070=0.011
min4.202-4.093=0.109
max4.698-4.591=0.107
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002-0.002=-0.000
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean3.929-4.231=-0.302
σ0.374-0.069=0.305
min3.452-4.106=-0.654
max4.547-4.511=0.035
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.768-0.742=0.027
σ0.035-0.025=0.010
min0.569-0.575=-0.006
max0.891-0.859=0.031
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.567-0.704=-0.137
σ0.094-0.015=0.080
min0.487-0.676=-0.189
max0.815-0.802=0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.194-295.572=-1.378
σ0.216-0.240=-0.025
min293.912-295.411=-1.499
max294.629-296.235=-1.605
mean2026.000-2031.000=-5.000
σ0.000
min2026.000-2031.000=-5.000
max2026.000-2031.000=-5.000
mean0.545-0.545=-0.001
σ0.035-0.029=0.006
min0.504-0.505=-0.001
max0.592-0.574=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.495-285.409=-3.913
σ0.041-0.031=0.010
min281.445-285.375=-3.930
max281.537-285.442=-3.905
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.394-0.386=0.008
σ0.008-0.007=0.001
min0.384-0.380=0.004
max0.400-0.398=0.002
iters=5
new-facts=1
prior-facts=6402
mean1291.483-1295.807=-4.324
σ0.104-0.111=-0.008
min1291.366-1295.682=-4.316
max1291.624-1295.951=-4.327
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean1.882-1.893=-0.011
σ0.095-0.089=0.006
min1.796-1.805=-0.010
max2.028-2.023=0.005
iters=5
new-facts=6402
prior-facts=1
mean1534.349-1539.915=-5.566
σ3.999-6.882=-2.884
min1532.358-1536.608=-4.250
max1541.497-1552.221=-10.725
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean2.177-2.297=-0.121
σ0.165-0.235=-0.071
min2.009-2.037=-0.028
max2.420-2.587=-0.168
iters=5
new-facts=6402
prior-facts=6402
mean1853.357-1857.710=-4.354
σ0.048-0.048=-0.001
min1853.300-1857.660=-4.360
max1853.414-1857.768=-4.353
mean1784.400-1789.200=-4.800
σ163.995-165.069=-1.074
min1653.000-1650.000=3.000
max2026.000-2031.000=-5.000
mean2.906-3.037=-0.131
σ0.075-0.252=-0.176
min2.838-2.839=-0.000
max2.992-3.461=-0.469

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.379-1.305=0.074
σ0.267-0.216=0.051
min1.102-1.107=-0.005
max1.816-1.628=0.187

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-445.740=-3.314
σ577.065-580.934=-3.870
min153.893-155.270=-1.377
max1308.023-1317.142=-9.119
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean0.543-0.524=0.019
σ0.569-0.537=0.032
min0.257-0.254=0.003
max1.397-1.330=0.067
policies=20
mean1539.203-1552.987=-13.784
σ0.332-0.328=0.005
min1538.974-1552.761=-13.787
max1539.697-1553.474=-13.777
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean2.592-2.587=0.005
σ0.015-0.015=-0.001
min2.574-2.572=0.001
max2.608-2.606=0.002
policies=200
mean15400.276-15537.993=-137.717
σ0.065-0.070=-0.005
min15400.217-15537.897=-137.680
max15400.356-15538.064=-137.708
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1650.000=3.000
σ0.000
min1653.000-1650.000=3.000
max1653.000-1650.000=3.000
mean26.094-26.155=-0.061
σ0.025-0.190=-0.166
min26.063-26.021=0.041
max26.123-26.433=-0.310