Compare commits

Home / Compare 47950538 .. 4ccd3372

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.031=0.001
σ0.370-0.369=0.001
min53.887-53.891=-0.004
max55.084-55.080=0.004
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.140-0.140=-0.000
σ0.005-0.003=0.002
min0.132-0.137=-0.005
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.383-43.384=-0.000
σ0.008-0.006=0.002
min43.369-43.375=-0.006
max43.395-43.397=-0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.122-0.122=0.000
σ0.005-0.003=0.002
min0.115-0.119=-0.004
max0.132-0.127=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.335-1006.331=0.003
σ0.874-0.882=-0.007
min1005.832-1005.836=-0.003
max1009.950-1009.981=-0.031
mean1054.650-1050.100=4.550
σ318.302-306.907=11.394
min563.000-584.000=-21.000
max1634.000-1648.000=-14.000
mean1.558-1.545=0.013
σ0.055-0.076=-0.021
min1.493-1.381=0.112
max1.663-1.651=0.012

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.430-0.422=0.007
σ0.126-0.135=-0.009
min0.356-0.343=0.013
max0.653-0.661=-0.008
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.882-0.874=0.008
σ0.092-0.092=-0.001
min0.819-0.822=-0.002
max1.043-1.036=0.007
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.548-0.572=-0.024
σ0.054-0.061=-0.006
min0.497-0.509=-0.013
max0.638-0.649=-0.011
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.881-1.006=-0.125
σ0.056-0.328=-0.272
min0.833-0.820=0.013
max0.956-1.589=-0.633

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.552=-0.001
σ0.025-0.024=0.001
min963.526-963.523=0.003
max963.590-963.582=0.008
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.832-0.821=0.011
σ0.060-0.044=0.016
min0.725-0.745=-0.019
max0.865-0.852=0.012
name=cdr_enhanced_4k_loc.art
mean884.855-884.856=-0.001
σ0.009-0.005=0.003
min884.847
max884.867-884.861=0.007
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.705-0.713=-0.008
σ0.050-0.039=0.011
min0.628-0.653=-0.026
max0.744-0.741=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.713=-0.001
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean4.284-3.536=0.748
σ0.096-0.092=0.004
min4.122-3.380=0.742
max4.657-3.782=0.875
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean4.249-4.155=0.094
σ0.073-0.272=-0.199
min4.090-3.405=0.686
max4.542-4.541=0.001
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.750-0.747=0.002
σ0.023-0.018=0.005
min0.712-0.711=0.002
max0.892-0.863=0.030
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.714-0.716=-0.001
σ0.026-0.018=0.008
min0.681-0.685=-0.004
max0.896-0.826=0.070

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.652-295.599=0.054
σ0.250-0.241=0.009
min295.515-295.462=0.053
max296.337-296.277=0.060
mean1896.000-1903.000=-7.000
σ0.000
min1896.000-1903.000=-7.000
max1896.000-1903.000=-7.000
mean0.568-0.581=-0.012
σ0.063-0.043=0.020
min0.494-0.533=-0.039
max0.711-0.686=0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.249-285.252=-0.003
σ0.041-0.038=0.003
min285.191-285.205=-0.013
max285.292-285.291=0.001
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.398-0.391=0.007
σ0.011-0.011=-0.000
min0.391-0.380=0.011
max0.414-0.406=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.193-1295.200=-0.007
σ0.109-0.114=-0.005
min1295.069-1295.077=-0.008
max1295.329-1295.342=-0.013
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean1.876-1.930=-0.054
σ0.094-0.105=-0.012
min1.786-1.798=-0.011
max2.020-2.023=-0.003
iters=5
new-facts=6402
prior-facts=1
mean1538.095-1538.075=0.020
σ4.015-4.010=0.005
min1536.109-1536.032=0.077
max1545.272-1545.238=0.034
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean2.157-2.262=-0.104
σ0.161-0.204=-0.044
min1.995-2.006=-0.011
max2.365-2.508=-0.144
iters=5
new-facts=6402
prior-facts=6402
mean1857.112-1857.110=0.002
σ0.049-0.054=-0.005
min1857.063-1857.053=0.011
max1857.179-1857.183=-0.004
mean1765.600-1772.400=-6.800
σ125.373-127.688=-2.316
min1634.000-1648.000=-14.000
max1896.000-1903.000=-7.000
mean3.140-3.053=0.086
σ0.355-0.305=0.050
min2.900-2.838=0.062
max3.758-3.578=0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.467-1.369=0.098
σ0.238-0.276=-0.038
min1.260-1.102=0.158
max1.825-1.823=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.609=0.001
σ577.065-577.065=0.000
min155.075-155.075=-0.000
max1309.208-1309.206=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean0.550-0.548=0.002
σ0.578-0.569=0.009
min0.256-0.262=-0.006
max1.418-1.402=0.016
policies=20
mean1551.041-1551.023=0.018
σ0.330-0.316=0.013
min1550.814-1550.806=0.009
max1551.530-1551.493=0.038
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean2.592-2.582=0.009
σ0.010-0.015=-0.005
min2.580-2.571=0.008
max2.604-2.605=-0.001
policies=200
mean15518.533-15518.566=-0.033
σ0.109-0.087=0.022
min15518.460-15518.471=-0.011
max15518.693-15518.676=0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1648.000=-14.000
σ0.000
min1634.000-1648.000=-14.000
max1634.000-1648.000=-14.000
mean26.157-26.382=-0.225
σ0.093-0.167=-0.074
min26.048-26.255=-0.207
max26.269-26.623=-0.354