Compare commits

Home / Compare e079f047 .. 9938b298

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.705=-0.001
σ0.368-0.365=0.003
min53.556-53.565=-0.009
max54.751-54.744=0.007
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.138-0.137=0.000
σ0.005-0.005=-0.001
min0.129-0.130=-0.000
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.058-43.059=-0.002
σ0.006-0.007=-0.001
min43.049-43.049=-0.000
max43.066-43.069=-0.004
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.122-0.121=0.000
σ0.003-0.004=-0.001
min0.118-0.118=0.000
max0.127-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.108-1005.104=0.004
σ0.875-0.894=-0.019
min1004.620-1004.640=-0.020
max1008.735-1008.809=-0.074
mean1052.950-1050.200=2.750
σ321.163-315.471=5.693
min552.000-593.000=-41.000
max1632.000-1653.000=-21.000
mean1.621-1.617=0.003
σ0.088-0.106=-0.017
min1.478-1.450=0.028
max1.860-1.895=-0.035

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.498-0.448=0.050
σ0.187-0.127=0.060
min0.353-0.368=-0.015
max0.712-0.671=0.041
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.912-0.909=0.004
σ0.110-0.095=0.015
min0.839-0.834=0.005
max1.108-1.072=0.036
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.553-0.546=0.007
σ0.052-0.057=-0.005
min0.514-0.492=0.022
max0.644-0.637=0.008
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.891-0.877=0.014
σ0.054-0.066=-0.012
min0.831-0.808=0.023
max0.973-0.963=0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.552=0.001
σ0.035-0.025=0.010
min963.533-963.524=0.009
max963.615-963.584=0.031
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.826-0.835=-0.009
σ0.051-0.030=0.022
min0.761-0.797=-0.036
max0.865-0.865=0.000
name=cdr_enhanced_4k_loc.art
mean884.853-884.857=-0.003
σ0.008-0.007=0.001
min884.847
max884.867-884.866=0.000
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.736-0.737=-0.001
σ0.034-0.021=0.013
min0.675-0.705=-0.030
max0.758-0.758=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.711=-0.000
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean4.285-4.321=-0.037
σ0.072-0.080=-0.008
min4.146-4.202=-0.057
max4.603-4.698=-0.095
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean4.248-3.929=0.320
σ0.087-0.374=-0.286
min4.101-3.452=0.649
max4.639-4.547=0.093
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.766-0.768=-0.002
σ0.022-0.035=-0.013
min0.737-0.569=0.168
max0.928-0.891=0.038
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.723-0.567=0.156
σ0.017-0.094=-0.077
min0.681-0.487=0.194
max0.796-0.815=-0.019

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.181-294.194=-0.013
σ0.187-0.216=-0.028
min293.987-293.912=0.075
max294.669-294.629=0.040
mean1939.000-2026.000=-87.000
σ0.000
min1939.000-2026.000=-87.000
max1939.000-2026.000=-87.000
mean0.563-0.545=0.018
σ0.052-0.035=0.017
min0.487-0.504=-0.017
max0.661-0.592=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497-281.495=0.001
σ0.040-0.041=-0.001
min281.448-281.445=0.003
max281.539-281.537=0.002
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.394-0.394=0.000
σ0.006-0.008=-0.002
min0.386-0.384=0.002
max0.400-0.400=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1291.476-1291.483=-0.007
σ0.103-0.104=-0.001
min1291.360-1291.366=-0.006
max1291.612-1291.624=-0.012
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean1.982-1.882=0.100
σ0.160-0.095=0.065
min1.839-1.796=0.043
max2.249-2.028=0.221
iters=5
new-facts=6402
prior-facts=1
mean1534.321-1534.349=-0.028
σ4.013-3.999=0.015
min1532.297-1532.358=-0.061
max1541.491-1541.497=-0.006
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean2.222-2.177=0.046
σ0.190-0.165=0.025
min2.036-2.009=0.026
max2.462-2.420=0.043
iters=5
new-facts=6402
prior-facts=6402
mean1853.354-1853.357=-0.002
σ0.049-0.048=0.002
min1853.307-1853.300=0.007
max1853.423-1853.414=0.009
mean1792.800-1784.400=8.400
σ147.298-163.995=-16.697
min1632.000-1653.000=-21.000
max1939.000-2026.000=-87.000
mean3.137-2.906=0.230
σ0.281-0.075=0.206
min2.905-2.838=0.067
max3.622-2.992=0.629

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.487-1.379=0.108
σ0.289-0.267=0.022
min1.122-1.102=0.020
max1.889-1.816=0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.430-442.427=0.003
σ577.064-577.065=-0.000
min153.896-153.893=0.003
max1308.026-1308.023=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean0.552-0.543=0.009
σ0.590-0.569=0.021
min0.255-0.257=-0.002
max1.436-1.397=0.040
policies=20
mean1539.224-1539.203=0.021
σ0.316-0.332=-0.017
min1539.004-1538.974=0.030
max1539.693-1539.697=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean2.571-2.592=-0.021
σ0.010-0.015=-0.004
min2.560-2.574=-0.014
max2.581-2.608=-0.026
policies=200
mean15400.412-15400.276=0.136
σ0.053-0.065=-0.012
min15400.358-15400.217=0.142
max15400.484-15400.356=0.128
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1653.000=-21.000
σ0.000
min1632.000-1653.000=-21.000
max1632.000-1653.000=-21.000
mean26.049-26.094=-0.044
σ0.047-0.025=0.022
min25.991-26.063=-0.072
max26.102-26.123=-0.021