Compare commits

Home / Compare 1be0da6b .. ea5265b1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-54.046=-0.340
σ0.367-0.368=-0.000
min53.565-53.903=-0.337
max54.751-55.092=-0.341
mean416.700-415.800=0.900
σ0.483-0.422=0.061
min416.000-415.000=1.000
max417.000-416.000=1.000
mean0.140-0.138=0.001
σ0.003-0.005=-0.002
min0.136-0.131=0.006
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.059-43.385=-0.326
σ0.006-0.006=0.001
min43.048-43.376=-0.328
max43.067-43.394=-0.327
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.123-0.122=0.000
σ0.004-0.005=-0.001
min0.118-0.116=0.003
max0.129-0.131=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1006.983=-1.878
σ0.888-0.853=0.034
min1004.637-1006.482=-1.845
max1008.782-1010.495=-1.714
mean1055.100-1044.400=10.700
σ321.597-313.668=7.929
min553.000-576.000=-23.000
max1632.000-1638.000=-6.000
mean1.628-1.557=0.071
σ0.090-0.082=0.007
min1.556-1.485=0.070
max1.879-1.822=0.057

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.001
min0.881-0.882=-0.000
max0.886-0.888=-0.003
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.418-0.419=-0.001
σ0.135-0.146=-0.010
min0.335-0.338=-0.003
max0.658-0.678=-0.020
name=error_case.art
mean2.333-2.340=-0.006
σ0.003-0.003=-0.000
min2.332-2.337=-0.005
max2.337-2.344=-0.007
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.878-0.875=0.002
σ0.086-0.086=0.001
min0.830-0.819=0.011
max1.031-1.025=0.006
name=heavy_item.art
mean1.521-1.523=-0.002
σ0.002-0.001=0.001
min1.520-1.522=-0.002
max1.524-1.525=-0.001
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.542-0.535=0.006
σ0.057-0.052=0.005
min0.485-0.495=-0.011
max0.636-0.624=0.012
name=nested_use.art
mean2.355-2.362=-0.006
σ0.002-0.002=-0.000
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.840-0.836=0.004
σ0.039-0.040=-0.001
min0.808-0.809=-0.001
max0.904-0.907=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-964.829=-1.274
σ0.026-0.024=0.002
min963.535-964.802=-1.267
max963.599-964.862=-1.263
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.827-0.805=0.022
σ0.039-0.054=-0.015
min0.773-0.727=0.046
max0.860-0.856=0.005
name=cdr_enhanced_4k_loc.art
mean884.853-885.514=-0.661
σ0.008-0.006=0.003
min884.847-885.505=-0.659
max884.866-885.519=-0.653
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.713-0.687=0.026
σ0.065-0.052=0.014
min0.596-0.609=-0.013
max0.746-0.734=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.712-7.719=-0.007
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean4.266-3.484=0.782
σ0.067-0.072=-0.005
min4.148-3.367=0.781
max4.538-3.851=0.687
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002-0.002=-0.000
min7.654-7.664=-0.010
max7.658-7.669=-0.011
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean4.265-3.486=0.779
σ0.069-0.061=0.008
min4.144-3.369=0.775
max4.636-3.690=0.946
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.745-0.733=0.012
σ0.016-0.022=-0.006
min0.717-0.670=0.048
max0.863-0.836=0.027
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.703-0.698=0.005
σ0.016-0.017=-0.001
min0.678-0.657=0.021
max0.803-0.780=0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.342-295.471=-1.129
σ0.279-0.233=0.046
min294.065-295.314=-1.249
max295.075-296.075=-0.999
mean1974.000-1904.000=70.000
σ0.000
min1974.000-1904.000=70.000
max1974.000-1904.000=70.000
mean0.570-0.585=-0.015
σ0.067-0.041=0.027
min0.495-0.507=-0.013
max0.717-0.641=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-285.413=-3.920
σ0.036-0.036=-0.000
min281.453-285.368=-3.915
max281.529-285.453=-3.924
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.379-0.389=-0.009
σ0.001-0.012=-0.011
min0.378-0.379=-0.001
max0.380-0.406=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1291.479-1295.798=-4.319
σ0.117-0.112=0.005
min1291.352-1295.671=-4.320
max1291.646-1295.930=-4.283
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean1.928-1.966=-0.038
σ0.109-0.190=-0.081
min1.788-1.817=-0.029
max2.046-2.282=-0.236
iters=5
new-facts=6402
prior-facts=1
mean1534.344-1539.931=-5.588
σ4.031-6.852=-2.821
min1532.322-1536.655=-4.332
max1541.543-1552.182=-10.639
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean2.349-2.300=0.049
σ0.263-0.243=0.019
min2.093-2.034=0.060
max2.705-2.590=0.115
iters=5
new-facts=6402
prior-facts=6402
mean1853.374-1857.704=-4.330
σ0.078-0.054=0.024
min1853.284-1857.649=-4.366
max1853.469-1857.779=-4.311
mean1802.800-1772.800=30.000
σ168.869-130.325=38.544
min1632.000-1638.000=-6.000
max1974.000-1904.000=70.000
mean3.253-3.046=0.206
σ0.334-0.241=0.093
min2.892-2.851=0.040
max3.656-3.453=0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.424-1.352=0.072
σ0.305-0.274=0.031
min1.102-1.103=-0.002
max1.873-1.822=0.051

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-445.739=-3.310
σ577.063-580.935=-3.871
min153.895-155.269=-1.374
max1308.024-1317.141=-9.117
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean0.521-0.542=-0.021
σ0.515-0.568=-0.053
min0.261-0.257=0.004
max1.293-1.393=-0.100
policies=20
mean1539.224-1552.977=-13.753
σ0.321-0.319=0.002
min1538.999-1552.749=-13.750
max1539.700-1553.450=-13.750
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean2.573-2.577=-0.003
σ0.016-0.016=0.000
min2.554-2.565=-0.011
max2.589-2.600=-0.011
policies=200
mean15400.365-15537.936=-137.572
σ0.085-0.067=0.018
min15400.270-15537.845=-137.575
max15400.467-15538.000=-137.533
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1638.000=-6.000
σ0.000
min1632.000-1638.000=-6.000
max1632.000-1638.000=-6.000
mean25.961-26.085=-0.124
σ0.075-0.115=-0.040
min25.862-25.967=-0.106
max26.035-26.219=-0.184