Compare commits

Home / Compare 016b3beb .. 2dbba837

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.706=-0.001
σ0.365-0.367=-0.002
min53.565-53.565=-0.001
max54.744-54.751=-0.007
mean416.000-416.700=-0.700
σ0.000-0.483=-0.483
min416.000
max416.000-417.000=-1.000
mean0.137-0.140=-0.003
σ0.005-0.003=0.002
min0.130-0.136=-0.007
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.059-43.059=0.000
σ0.007-0.006=0.001
min43.049-43.048=0.002
max43.069-43.067=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.123=-0.001
σ0.004-0.004=-0.000
min0.118-0.118=-0.000
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.104-1005.105=-0.001
σ0.894-0.888=0.006
min1004.640-1004.637=0.003
max1008.809-1008.782=0.028
mean1050.200-1055.100=-4.900
σ315.471-321.597=-6.126
min593.000-553.000=40.000
max1653.000-1632.000=21.000
mean1.617-1.628=-0.011
σ0.106-0.090=0.016
min1.450-1.556=-0.105
max1.895-1.879=0.017

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.448-0.418=0.030
σ0.127-0.135=-0.009
min0.368-0.335=0.033
max0.671-0.658=0.014
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.909-0.878=0.031
σ0.095-0.086=0.009
min0.834-0.830=0.004
max1.072-1.031=0.041
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.546-0.542=0.004
σ0.057-0.057=0.000
min0.492-0.485=0.007
max0.637-0.636=0.000
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.877-0.840=0.037
σ0.066-0.039=0.027
min0.808-0.808=-0.001
max0.963-0.904=0.059

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.554=-0.002
σ0.025-0.026=-0.001
min963.524-963.535=-0.010
max963.584-963.599=-0.015
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.835-0.827=0.008
σ0.030-0.039=-0.010
min0.797-0.773=0.024
max0.865-0.860=0.004
name=cdr_enhanced_4k_loc.art
mean884.857-884.853=0.004
σ0.007-0.008=-0.001
min884.847
max884.866-884.866=0.000
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.737-0.713=0.025
σ0.021-0.065=-0.044
min0.705-0.596=0.109
max0.758-0.746=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.712=-0.001
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean4.321-4.266=0.055
σ0.080-0.067=0.014
min4.202-4.148=0.055
max4.698-4.538=0.160
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean3.929-4.265=-0.336
σ0.374-0.069=0.305
min3.452-4.144=-0.692
max4.547-4.636=-0.089
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.768-0.745=0.023
σ0.035-0.016=0.018
min0.569-0.717=-0.148
max0.891-0.863=0.028
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.567-0.703=-0.136
σ0.094-0.016=0.079
min0.487-0.678=-0.190
max0.815-0.803=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.194-294.342=-0.148
σ0.216-0.279=-0.063
min293.912-294.065=-0.153
max294.629-295.075=-0.446
mean2026.000-1974.000=52.000
σ0.000
min2026.000-1974.000=52.000
max2026.000-1974.000=52.000
mean0.545-0.570=-0.025
σ0.035-0.067=-0.032
min0.504-0.495=0.009
max0.592-0.717=-0.124

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.495-281.493=0.002
σ0.041-0.036=0.005
min281.445-281.453=-0.007
max281.537-281.529=0.008
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.394-0.379=0.014
σ0.008-0.001=0.007
min0.384-0.378=0.006
max0.400-0.380=0.020
iters=5
new-facts=1
prior-facts=6402
mean1291.483-1291.479=0.004
σ0.104-0.117=-0.013
min1291.366-1291.352=0.015
max1291.624-1291.646=-0.022
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean1.882-1.928=-0.046
σ0.095-0.109=-0.014
min1.796-1.788=0.008
max2.028-2.046=-0.017
iters=5
new-facts=6402
prior-facts=1
mean1534.349-1534.344=0.005
σ3.999-4.031=-0.032
min1532.358-1532.322=0.036
max1541.497-1541.543=-0.046
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean2.177-2.349=-0.172
σ0.165-0.263=-0.098
min2.009-2.093=-0.084
max2.420-2.705=-0.286
iters=5
new-facts=6402
prior-facts=6402
mean1853.357-1853.374=-0.017
σ0.048-0.078=-0.030
min1853.300-1853.284=0.016
max1853.414-1853.469=-0.054
mean1784.400-1802.800=-18.400
σ163.995-168.869=-4.874
min1653.000-1632.000=21.000
max2026.000-1974.000=52.000
mean2.906-3.253=-0.346
σ0.075-0.334=-0.259
min2.838-2.892=-0.053
max2.992-3.656=-0.664

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.379-1.424=-0.045
σ0.267-0.305=-0.037
min1.102-1.102=0.000
max1.816-1.873=-0.057

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-442.429=-0.002
σ577.065-577.063=0.001
min153.893-153.895=-0.002
max1308.023-1308.024=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean0.543-0.521=0.023
σ0.569-0.515=0.054
min0.257-0.261=-0.004
max1.397-1.293=0.104
policies=20
mean1539.203-1539.224=-0.021
σ0.332-0.321=0.012
min1538.974-1538.999=-0.025
max1539.697-1539.700=-0.003
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean2.592-2.573=0.018
σ0.015-0.016=-0.001
min2.574-2.554=0.020
max2.608-2.589=0.019
policies=200
mean15400.276-15400.365=-0.089
σ0.065-0.085=-0.020
min15400.217-15400.270=-0.053
max15400.356-15400.467=-0.111
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1632.000=21.000
σ0.000
min1653.000-1632.000=21.000
max1653.000-1632.000=21.000
mean26.094-25.961=0.133
σ0.025-0.075=-0.050
min26.063-25.862=0.201
max26.123-26.035=0.088