Compare commits

Home / Compare 01190d84 .. 30fcebbb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.016=-0.002
σ0.368-0.370=-0.002
min53.878-53.879=-0.002
max55.063-55.070=-0.007
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.139-0.140=-0.000
σ0.003-0.005=-0.001
min0.135-0.136=-0.000
max0.145-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.000
σ0.007-0.005=0.002
min43.307-43.312=-0.005
max43.335-43.330=0.005
mean416.000-421.000=-5.000
σ0.000
min416.000-421.000=-5.000
max416.000-421.000=-5.000
mean0.123-0.123=-0.000
σ0.004-0.005=-0.001
min0.119-0.119=-0.000
max0.130-0.133=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.303-1006.307=-0.004
σ1.171-1.188=-0.016
min1005.768-1005.770=-0.001
max1011.208-1011.287=-0.079
mean1051.050-1057.050=-6.000
σ314.662-304.380=10.283
min599.000-591.000=8.000
max1651.000-1649.000=2.000
mean1.563-1.563=0.000
σ0.089-0.089=-0.000
min1.408-1.468=-0.060
max1.791-1.780=0.011

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.412-0.411=0.001
σ0.153-0.132=0.021
min0.319-0.316=0.002
max0.684-0.644=0.040
name=error_case.art
mean2.337-2.338=-0.001
σ0.003-0.002=0.000
min2.336
max2.341
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.896-0.888=0.008
σ0.098-0.085=0.013
min0.839-0.841=-0.003
max1.069-1.038=0.030
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.556-0.535=0.021
σ0.054-0.056=-0.002
min0.517-0.485=0.031
max0.648-0.628=0.019
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.858-0.840=0.018
σ0.022-0.039=-0.017
min0.834-0.806=0.029
max0.885-0.896=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.113=0.001
σ0.033-0.032=0.001
min964.086-964.085=0.001
max964.170-964.166=0.004
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.829-0.836=-0.007
σ0.031-0.031=-0.000
min0.779-0.781=-0.002
max0.852-0.854=-0.003
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.007-0.007=-0.000
min884.703-884.705=-0.001
max884.722-884.722=-0.001
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.733-0.702=0.031
σ0.018-0.028=-0.010
min0.704-0.668=0.036
max0.748-0.742=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean3.560-4.253=-0.693
σ0.070-0.093=-0.023
min3.432-4.109=-0.677
max3.910-4.598=-0.687
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean3.569-4.196=-0.627
σ0.064-0.078=-0.014
min3.450-4.049=-0.599
max3.801-4.453=-0.652
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.748-0.739=0.009
σ0.019-0.021=-0.002
min0.719-0.710=0.010
max0.864-0.859=0.005
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.708-0.685=0.023
σ0.020-0.047=-0.027
min0.670-0.485=0.184
max0.777-0.754=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.256-296.272=-0.016
σ0.255-0.266=-0.011
min295.991-296.108=-0.117
max296.913-297.001=-0.089
mean1910.000-1917.000=-7.000
σ0.000
min1910.000-1917.000=-7.000
max1910.000-1917.000=-7.000
mean0.581-0.591=-0.010
σ0.040-0.027=0.012
min0.508-0.544=-0.036
max0.669-0.639=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.641-284.642=-0.001
σ0.063-0.068=-0.005
min284.567-284.570=-0.003
max284.713-284.724=-0.011
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.399-0.400=-0.000
σ0.012-0.012=0.000
min0.387-0.385=0.001
max0.414-0.414=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.084-1295.091=-0.007
σ0.100-0.108=-0.008
min1295.026-1295.024=0.002
max1295.262-1295.284=-0.021
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean1.917-1.917=-0.000
σ0.102-0.096=0.007
min1.805-1.806=-0.000
max2.021-2.024=-0.002
iters=5
new-facts=6402
prior-facts=1
mean1539.270-1539.246=0.025
σ6.844-6.867=-0.023
min1535.926-1535.982=-0.055
max1551.507-1551.525=-0.018
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean2.355-2.237=0.118
σ0.221-0.207=0.014
min2.019-2.008=0.011
max2.612-2.503=0.109
iters=5
new-facts=6402
prior-facts=6402
mean1856.971-1856.970=0.001
σ0.066-0.069=-0.003
min1856.920-1856.922=-0.002
max1857.070-1857.083=-0.013
mean1779.000-1777.400=1.600
σ128.410-134.584=-6.174
min1651.000-1649.000=2.000
max1910.000-1917.000=-7.000
mean3.029-3.009=0.020
σ0.193-0.178=0.015
min2.851-2.843=0.009
max3.349-3.296=0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.229-1.195=0.034
σ0.349-0.251=0.098
min0.943-0.939=0.003
max1.818-1.542=0.276

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.242-448.242=0.000
σ581.217-581.218=-0.001
min157.630-157.631=-0.001
max1320.067-1320.069=-0.002
mean98.250
σ8.500
min94.000
max111.000
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean0.543-0.557=-0.014
σ0.558-0.587=-0.029
min0.262-0.263=-0.001
max1.380-1.438=-0.057
policies=20
mean1576.650-1576.626=0.024
σ0.369-0.359=0.010
min1576.399-1576.382=0.017
max1577.198-1577.160=0.038
mean940.000
σ0.000
min940.000
max940.000
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean2.643-2.628=0.015
σ0.011-0.017=-0.006
min2.633-2.614=0.019
max2.656-2.653=0.003
policies=200
mean15774.771-15774.720=0.051
σ0.098-0.159=-0.062
min15774.667-15774.567=0.100
max15774.900-15774.941=-0.041
mean9400.000
σ0.000
min9400.000
max9400.000
mean1651.000-1649.000=2.000
σ0.000
min1651.000-1649.000=2.000
max1651.000-1649.000=2.000
mean26.725-26.648=0.076
σ0.080-0.033=0.048
min26.627-26.619=0.008
max26.820-26.694=0.126