Compare commits

Home / Compare 08a28d67 .. 292fbd64

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.018-54.013=0.004
σ0.369-0.369=0.000
min53.867-53.874=-0.007
max55.067-55.062=0.005
mean416.000
σ0.000
min416.000
max416.000
mean0.146-0.136=0.010
σ0.014-0.005=0.009
min0.131-0.129=0.002
max0.168-0.147=0.021
cache=y
dps=1
iters=10
policies=100
mean43.325-43.323=0.002
σ0.008-0.006=0.002
min43.315-43.314=0.001
max43.343-43.333=0.010
mean416.000
σ0.000
min416.000
max416.000
mean0.133-0.121=0.011
σ0.011-0.003=0.008
min0.116-0.119=-0.003
max0.145-0.128=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.311-1006.309=0.002
σ1.181-1.169=0.012
min1005.753-1005.773=-0.021
max1011.256-1011.207=0.049
mean1051.550-1047.400=4.150
σ304.949-314.403=-9.455
min597.000-577.000=20.000
max1644.000
mean1.536-1.573=-0.036
σ0.058-0.086=-0.028
min1.479-1.489=-0.010
max1.643-1.811=-0.168

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.424-0.415=0.008
σ0.148-0.155=-0.007
min0.344-0.325=0.019
max0.686-0.691=-0.005
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.919-0.935=-0.016
σ0.165-0.173=-0.008
min0.821-0.839=-0.017
max1.210-1.243=-0.033
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.544-0.551=-0.008
σ0.049-0.051=-0.002
min0.509-0.513=-0.004
max0.628-0.638=-0.010
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.843-0.863=-0.019
σ0.040-0.036=0.004
min0.821-0.836=-0.015
max0.913-0.924=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.111=0.001
σ0.019-0.022=-0.003
min964.097-964.083=0.014
max964.145-964.140=0.005
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.816-0.815=0.001
σ0.032-0.044=-0.012
min0.790-0.766=0.025
max0.851-0.864=-0.012
name=cdr_enhanced_4k_loc.art
mean884.713-884.716=-0.003
σ0.005-0.006=-0.001
min884.705-884.711=-0.006
max884.720-884.726=-0.007
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.678-0.732=-0.054
σ0.063-0.024=0.040
min0.596-0.690=-0.094
max0.733-0.748=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1644.000
σ0.000
min1644.000
max1644.000
mean3.474-4.218=-0.745
σ0.074-0.075=-0.001
min3.299-4.093=-0.794
max3.790-4.467=-0.677
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=-0.000
min7.662
max7.669-7.669=0.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean3.467-4.226=-0.759
σ0.072-0.087=-0.015
min3.331-4.049=-0.717
max3.841-4.476=-0.635
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.738-0.746=-0.008
σ0.018-0.029=-0.011
min0.711-0.707=0.004
max0.831-0.873=-0.041
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.703-0.695=0.007
σ0.013-0.017=-0.004
min0.664-0.659=0.005
max0.760-0.784=-0.025

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.226-296.319=-0.092
σ0.203-0.224=-0.021
min296.039-296.137=-0.098
max296.768-296.913=-0.145
mean1903.000-1904.000=-1.000
σ0.000
min1903.000-1904.000=-1.000
max1903.000-1904.000=-1.000
mean0.578-0.570=0.007
σ0.029-0.051=-0.023
min0.508-0.502=0.006
max0.607-0.674=-0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.696=-0.002
σ0.037-0.039=-0.002
min284.647-284.642=0.006
max284.732-284.739=-0.007
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.397-0.397=-0.000
σ0.012-0.011=0.001
min0.384-0.385=-0.001
max0.407-0.406=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.074-1295.082=-0.008
σ0.108-0.123=-0.015
min1294.961-1294.958=0.003
max1295.199-1295.265=-0.066
mean1644.000
σ0.000
min1644.000
max1644.000
mean1.922-1.919=0.002
σ0.097-0.103=-0.006
min1.816-1.814=0.002
max2.012-2.066=-0.054
iters=5
new-facts=6402
prior-facts=1
mean1539.192-1539.192=0.000
σ6.857-6.836=0.021
min1535.881-1535.975=-0.093
max1551.452-1551.417=0.035
mean1644.000
σ0.000
min1644.000
max1644.000
mean2.281-2.167=0.114
σ0.197-0.142=0.055
min2.039-1.992=0.047
max2.465-2.336=0.129
iters=5
new-facts=6402
prior-facts=6402
mean1856.978-1856.974=0.004
σ0.067-0.067=0.000
min1856.897-1856.895=0.001
max1857.072-1857.065=0.007
mean1772.000-1773.400=-1.400
σ128.410-129.525=-1.116
min1644.000
max1903.000-1904.000=-1.000
mean3.060-3.006=0.054
σ0.291-0.178=0.114
min2.845-2.866=-0.020
max3.567-3.314=0.253

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.154-1.106=0.048
σ0.225-0.207=0.018
min0.931-0.927=0.004
max1.501-1.391=0.110

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.785=-0.001
σ581.212-581.213=-0.001
min157.177-157.175=0.002
max1319.603-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.547-0.523=0.024
σ0.567-0.531=0.037
min0.262-0.256=0.006
max1.398-1.320=0.079
policies=20
mean1572.085-1572.099=-0.014
σ0.356-0.351=0.005
min1571.843-1571.860=-0.017
max1572.614-1572.621=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean2.627-2.629=-0.001
σ0.024-0.015=0.009
min2.605-2.614=-0.009
max2.652-2.647=0.004
policies=200
mean15728.985-15729.059=-0.074
σ0.082-0.053=0.029
min15728.889-15728.992=-0.103
max15729.057-15729.113=-0.056
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean26.509-26.531=-0.022
σ0.025-0.208=-0.183
min26.480-26.357=0.123
max26.540-26.827=-0.287