Compare commits

Home / Compare 4b8cb1dc .. 1a682d18

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.703=0.001
σ0.367-0.368=-0.001
min53.565-53.556=0.009
max54.750-54.751=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.137-0.138=-0.000
σ0.005-0.005=0.001
min0.129-0.129=0.000
max0.147-0.144=0.004
cache=y
dps=1
iters=10
policies=100
mean43.059-43.058=0.001
σ0.006-0.006=0.000
min43.050-43.049=0.001
max43.069-43.066=0.004
mean413.000
σ0.000
min413.000
max413.000
mean0.122-0.122=0.000
σ0.004-0.003=0.000
min0.118-0.118=0.000
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.104-1005.108=-0.005
σ0.892-0.875=0.017
min1004.640-1004.620=0.020
max1008.806-1008.735=0.071
mean1062.900-1052.950=9.950
σ328.165-321.163=7.002
min552.000
max1630.000-1632.000=-2.000
mean1.619-1.621=-0.002
σ0.098-0.088=0.010
min1.471-1.478=-0.007
max1.893-1.860=0.032

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=-0.000
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.448-0.498=-0.049
σ0.167-0.187=-0.020
min0.334-0.353=-0.019
max0.741-0.712=0.029
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.907-0.912=-0.005
σ0.170-0.110=0.060
min0.810-0.839=-0.029
max1.210-1.108=0.102
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.545-0.553=-0.008
σ0.048-0.052=-0.005
min0.513-0.514=-0.001
max0.623-0.644=-0.021
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.840-0.891=-0.051
σ0.036-0.054=-0.018
min0.802-0.831=-0.029
max0.899-0.973=-0.074

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.553=0.000
σ0.025-0.035=-0.010
min963.523-963.533=-0.011
max963.583-963.615=-0.032
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.794-0.826=-0.032
σ0.024-0.051=-0.028
min0.772-0.761=0.011
max0.822-0.865=-0.043
name=cdr_enhanced_4k_loc.art
mean884.855-884.853=0.002
σ0.005-0.008=-0.003
min884.847
max884.861-884.867=-0.006
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.728-0.736=-0.008
σ0.031-0.034=-0.004
min0.682-0.675=0.007
max0.755-0.758=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.711=-0.001
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean4.291-4.285=0.007
σ0.089-0.072=0.017
min4.134-4.146=-0.012
max4.800-4.603=0.197
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.660-7.658=0.002
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean4.282-4.248=0.034
σ0.108-0.087=0.020
min3.787-4.101=-0.314
max4.849-4.639=0.209
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.764-0.766=-0.002
σ0.022-0.022=0.000
min0.722-0.737=-0.015
max0.883-0.928=-0.046
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.733-0.723=0.009
σ0.019-0.017=0.002
min0.697-0.681=0.016
max0.821-0.796=0.025

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.186-294.181=0.004
σ0.215-0.187=0.028
min294.023-293.987=0.035
max294.772-294.669=0.102
mean1929.000-1939.000=-10.000
σ0.000
min1929.000-1939.000=-10.000
max1929.000-1939.000=-10.000
mean0.580-0.563=0.017
σ0.034-0.052=-0.017
min0.512-0.487=0.025
max0.613-0.661=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.494-281.497=-0.002
σ0.039-0.040=-0.001
min281.446-281.448=-0.002
max281.535-281.539=-0.004
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.388-0.394=-0.006
σ0.008-0.006=0.001
min0.378-0.386=-0.008
max0.398-0.400=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1291.481-1291.476=0.005
σ0.106-0.103=0.003
min1291.362-1291.360=0.002
max1291.607-1291.612=-0.005
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean1.882-1.982=-0.100
σ0.093-0.160=-0.067
min1.813-1.839=-0.026
max2.020-2.249=-0.229
iters=5
new-facts=6402
prior-facts=1
mean1534.334-1534.321=0.013
σ3.964-4.013=-0.050
min1532.331-1532.297=0.034
max1541.415-1541.491=-0.077
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean2.279-2.222=0.056
σ0.125-0.190=-0.064
min2.139-2.036=0.103
max2.416-2.462=-0.046
iters=5
new-facts=6402
prior-facts=6402
mean1853.357-1853.354=0.003
σ0.054-0.049=0.005
min1853.307-1853.307=-0.000
max1853.436-1853.423=0.012
mean1784.200-1792.800=-8.600
σ142.143-147.298=-5.155
min1630.000-1632.000=-2.000
max1929.000-1939.000=-10.000
mean3.077-3.137=-0.060
σ0.309-0.281=0.028
min2.874-2.905=-0.031
max3.620-3.622=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.376-1.487=-0.111
σ0.175-0.289=-0.114
min1.264-1.122=0.142
max1.666-1.889=-0.223

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-442.430=-0.002
σ577.064-577.064=-0.000
min153.893-153.896=-0.003
max1308.023-1308.026=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean0.537-0.552=-0.015
σ0.556-0.590=-0.034
min0.258-0.255=0.003
max1.371-1.436=-0.066
policies=20
mean1539.211-1539.224=-0.014
σ0.335-0.316=0.019
min1538.979-1539.004=-0.025
max1539.708-1539.693=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean2.595-2.571=0.025
σ0.024-0.010=0.014
min2.564-2.560=0.004
max2.619-2.581=0.038
policies=200
mean15400.420-15400.412=0.008
σ0.126-0.053=0.072
min15400.232-15400.358=-0.127
max15400.491-15400.484=0.007
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1632.000=-2.000
σ0.000
min1630.000-1632.000=-2.000
max1630.000-1632.000=-2.000
mean26.111-26.049=0.061
σ0.113-0.047=0.066
min25.946-25.991=-0.045
max26.197-26.102=0.095