Compare commits

Home / Compare 5156857f .. e34291db

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=0.000
σ0.367-0.369=-0.002
min53.867-53.872=-0.005
max55.059-55.064=-0.005
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.139-0.138=0.001
σ0.004-0.004=0.001
min0.131-0.133=-0.001
max0.148-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.000
σ0.006-0.007=-0.001
min43.315-43.312=0.002
max43.331-43.333=-0.003
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.000
min0.114-0.118=-0.004
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.309=0.001
σ1.168-1.170=-0.002
min1005.766-1005.764=0.001
max1011.200-1011.215=-0.016
mean1044.400-1048.350=-3.950
σ313.809-312.937=0.872
min594.000-600.000=-6.000
max1641.000-1643.000=-2.000
mean1.562-1.560=0.001
σ0.072-0.096=-0.024
min1.479-1.466=0.013
max1.769-1.802=-0.034

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.402-0.411=-0.009
σ0.129-0.134=-0.005
min0.319-0.334=-0.015
max0.628-0.649=-0.021
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.881-0.883=-0.002
σ0.106-0.097=0.008
min0.821-0.826=-0.005
max1.068-1.052=0.016
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.547-0.537=0.009
σ0.040-0.050=-0.010
min0.511-0.492=0.019
max0.613-0.621=-0.008
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.831-0.840=-0.009
σ0.042-0.036=0.006
min0.792-0.812=-0.020
max0.898-0.901=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.035-0.034=0.001
min964.086-964.086=0.000
max964.172-964.170=0.001
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.814-0.842=-0.028
σ0.019-0.028=-0.010
min0.791-0.793=-0.002
max0.838-0.864=-0.026
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=-0.000
σ0.007-0.008=-0.001
min884.705-884.705=0.000
max884.722-884.724=-0.002
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.709-0.667=0.042
σ0.041-0.038=0.003
min0.655-0.633=0.022
max0.745-0.731=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.002
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean4.206-3.505=0.701
σ0.094-0.078=0.016
min4.066-3.356=0.710
max4.624-3.792=0.832
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean4.187-3.509=0.678
σ0.074-0.068=0.005
min4.038-3.303=0.736
max4.474-3.706=0.767
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.739-0.530=0.209
σ0.018-0.014=0.004
min0.705-0.501=0.204
max0.852-0.609=0.242
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.698-0.501=0.197
σ0.026-0.012=0.014
min0.511-0.477=0.034
max0.782-0.554=0.228

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.140-296.128=0.012
σ0.210-0.257=-0.047
min295.956-295.968=-0.012
max296.700-296.838=-0.138
mean1896.000-1919.000=-23.000
σ0.000
min1896.000-1919.000=-23.000
max1896.000-1919.000=-23.000
mean0.573-0.581=-0.008
σ0.051-0.060=-0.009
min0.505-0.501=0.005
max0.687-0.690=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.702-284.689=0.013
σ0.028-0.043=-0.015
min284.673-284.637=0.035
max284.737-284.737=0.000
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.395-0.407=-0.012
σ0.009-0.004=0.006
min0.385-0.403=-0.017
max0.407-0.411=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.084=-0.004
σ0.103-0.113=-0.010
min1294.962-1294.956=0.006
max1295.202-1295.220=-0.018
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean1.900-1.879=0.021
σ0.086-0.077=0.009
min1.801-1.777=0.024
max1.978-1.959=0.019
iters=5
new-facts=6402
prior-facts=1
mean1539.223-1539.211=0.013
σ6.875-6.906=-0.031
min1535.964-1535.947=0.016
max1551.520-1551.561=-0.042
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean2.152-2.204=-0.053
σ0.139-0.153=-0.014
min2.050-2.048=0.002
max2.395-2.415=-0.020
iters=5
new-facts=6402
prior-facts=6402
mean1856.982-1856.988=-0.007
σ0.061-0.056=0.005
min1856.916-1856.939=-0.022
max1857.062-1857.073=-0.010
mean1766.800-1778.000=-11.200
σ123.777-136.686=-12.909
min1641.000-1643.000=-2.000
max1896.000-1919.000=-23.000
mean3.026-3.092=-0.066
σ0.263-0.316=-0.053
min2.795-2.851=-0.056
max3.456-3.640=-0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.208=-0.000
σ0.227-0.375=-0.148
min0.940-0.937=0.004
max1.536-1.837=-0.301

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.933-447.933=-0.000
σ581.505-581.505=0.000
min157.178-157.179=-0.000
max1320.191-1320.191=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean0.542-0.545=-0.003
σ0.564-0.564=-0.001
min0.258-0.259=-0.000
max1.388-1.392=-0.004
policies=20
mean1572.101-1572.119=-0.018
σ0.349-0.384=-0.035
min1571.865-1571.866=-0.002
max1572.621-1572.691=-0.071
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean2.628-2.678=-0.050
σ0.016-0.058=-0.042
min2.610-2.611=-0.001
max2.650-2.753=-0.103
policies=200
mean15729.077-15729.055=0.022
σ0.095-0.065=0.030
min15728.976-15728.962=0.014
max15729.197-15729.112=0.085
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1643.000=-2.000
σ0.000
min1641.000-1643.000=-2.000
max1641.000-1643.000=-2.000
mean26.560-26.622=-0.062
σ0.192-0.208=-0.017
min26.350-26.452=-0.102
max26.815-26.921=-0.106