Compare commits

Home / Compare ca696dfd .. ae49818d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.705=0.001
σ0.369-0.365=0.004
min53.569-53.565=0.004
max54.756-54.744=0.012
mean416.000
σ0.000
min416.000
max416.000
mean0.138-0.137=0.000
σ0.004-0.005=-0.001
min0.131-0.130=0.001
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.059-43.059=-0.001
σ0.006-0.007=-0.001
min43.053-43.049=0.004
max43.072-43.069=0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.120-0.121=-0.001
σ0.004-0.004=0.000
min0.115-0.118=-0.003
max0.127-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.107-1005.104=0.003
σ0.886-0.894=-0.008
min1004.640-1004.640=0.000
max1008.764-1008.809=-0.045
mean1062.350-1050.200=12.150
σ327.632-315.471=12.161
min553.000-593.000=-40.000
max1630.000-1653.000=-23.000
mean1.644-1.617=0.026
σ0.092-0.106=-0.013
min1.544-1.450=0.094
max1.850-1.895=-0.045

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.456-0.448=0.008
σ0.126-0.127=-0.001
min0.373-0.368=0.005
max0.677-0.671=0.006
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.902-0.909=-0.006
σ0.078-0.095=-0.017
min0.846-0.834=0.012
max1.037-1.072=-0.035
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.559-0.546=0.013
σ0.052-0.057=-0.004
min0.523-0.492=0.031
max0.651-0.637=0.015
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.871-0.877=-0.006
σ0.037-0.066=-0.029
min0.839-0.808=0.031
max0.932-0.963=-0.031

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.552=0.001
σ0.031-0.025=0.007
min963.535-963.524=0.011
max963.609-963.584=0.025
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.784-0.835=-0.051
σ0.074-0.030=0.044
min0.669-0.797=-0.128
max0.856-0.865=-0.008
name=cdr_enhanced_4k_loc.art
mean884.853-884.857=-0.003
σ0.006-0.007=-0.002
min884.847
max884.860-884.866=-0.007
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.741-0.737=0.003
σ0.017-0.021=-0.004
min0.727-0.705=0.022
max0.770-0.758=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean4.320-4.321=-0.001
σ0.089-0.080=0.009
min4.062-4.202=-0.140
max4.584-4.698=-0.115
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean4.300-3.929=0.371
σ0.076-0.374=-0.298
min4.170-3.452=0.718
max4.581-4.547=0.034
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.766-0.768=-0.002
σ0.023-0.035=-0.012
min0.705-0.569=0.136
max0.870-0.891=-0.020
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.717-0.567=0.150
σ0.020-0.094=-0.074
min0.681-0.487=0.194
max0.799-0.815=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.132-294.194=-0.062
σ0.236-0.216=0.020
min293.947-293.912=0.035
max294.760-294.629=0.131
mean1917.000-2026.000=-109.000
σ0.000
min1917.000-2026.000=-109.000
max1917.000-2026.000=-109.000
mean0.572-0.545=0.028
σ0.036-0.035=0.001
min0.515-0.504=0.011
max0.625-0.592=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.495=0.002
σ0.035-0.041=-0.007
min281.453-281.445=0.008
max281.533-281.537=-0.004
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.397-0.394=0.004
σ0.005-0.008=-0.003
min0.390-0.384=0.006
max0.405-0.400=0.004
iters=5
new-facts=1
prior-facts=6402
mean1291.483-1291.483=0.000
σ0.110-0.104=0.007
min1291.357-1291.366=-0.009
max1291.613-1291.624=-0.011
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean1.987-1.882=0.105
σ0.122-0.095=0.027
min1.817-1.796=0.021
max2.153-2.028=0.124
iters=5
new-facts=6402
prior-facts=1
mean1534.329-1534.349=-0.021
σ4.027-3.999=0.029
min1532.284-1532.358=-0.074
max1541.522-1541.497=0.025
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean2.286-2.177=0.109
σ0.161-0.165=-0.004
min2.028-2.009=0.018
max2.445-2.420=0.026
iters=5
new-facts=6402
prior-facts=6402
mean1853.351-1853.357=-0.006
σ0.056-0.048=0.008
min1853.309-1853.300=0.009
max1853.437-1853.414=0.022
mean1778.400-1784.400=-6.000
σ137.145-163.995=-26.850
min1630.000-1653.000=-23.000
max1917.000-2026.000=-109.000
mean3.098-2.906=0.192
σ0.359-0.075=0.284
min2.881-2.838=0.042
max3.735-2.992=0.743

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.471-1.379=0.092
σ0.240-0.267=-0.028
min1.265-1.102=0.164
max1.854-1.816=0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.428-442.427=0.001
σ577.065-577.065=0.001
min153.894-153.893=0.001
max1308.025-1308.023=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.553-0.543=0.009
σ0.585-0.569=0.016
min0.258-0.257=0.001
max1.431-1.397=0.034
policies=20
mean1539.215-1539.203=0.012
σ0.335-0.332=0.003
min1538.986-1538.974=0.011
max1539.713-1539.697=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean2.598-2.592=0.006
σ0.013-0.015=-0.002
min2.582-2.574=0.008
max2.614-2.608=0.006
policies=200
mean15400.469-15400.276=0.193
σ0.109-0.065=0.043
min15400.377-15400.217=0.160
max15400.619-15400.356=0.263
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean26.121-26.094=0.027
σ0.036-0.025=0.012
min26.071-26.063=0.008
max26.156-26.123=0.033