Compare commits

Home / Compare 571cc8fe .. b2d33e09

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-54.047=-0.341
σ0.369-0.371=-0.003
min53.559-53.897=-0.338
max54.755-55.104=-0.349
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.137-0.141=-0.003
σ0.004-0.004=0.000
min0.130-0.137=-0.006
max0.144-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.058-43.383=-0.325
σ0.007-0.005=0.001
min43.049-43.373=-0.325
max43.068-43.391=-0.323
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.120-0.120=0.000
σ0.004-0.004=-0.000
min0.115-0.114=0.001
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.103-1006.978=-1.875
σ0.912-0.876=0.035
min1004.634-1006.483=-1.849
max1008.834-1010.610=-1.776
mean1046.100-1046.350=-0.250
σ314.112-314.665=-0.553
min592.000-577.000=15.000
max1644.000
mean1.644-1.550=0.094
σ0.142-0.059=0.083
min1.469-1.473=-0.004
max2.087-1.719=0.369

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.003-0.002=0.000
min0.881-0.882=-0.000
max0.887-0.887=0.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.442-0.430=0.012
σ0.166-0.143=0.024
min0.338-0.348=-0.009
max0.738-0.683=0.055
name=error_case.art
mean2.334-2.339=-0.006
σ0.003-0.003=0.001
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.929-0.881=0.048
σ0.183-0.091=0.092
min0.834-0.813=0.021
max1.255-1.037=0.218
name=heavy_item.art
mean1.522-1.523=-0.001
σ0.002-0.001=0.001
min1.520-1.522=-0.002
max1.525-1.525=-0.001
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.549-0.538=0.012
σ0.046-0.051=-0.004
min0.497-0.499=-0.002
max0.624-0.622=0.002
name=nested_use.art
mean2.356-2.362=-0.006
σ0.002-0.002=-0.000
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.850-0.849=0.001
σ0.033-0.036=-0.003
min0.821-0.826=-0.005
max0.906-0.909=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-964.831=-1.277
σ0.024-0.024=-0.000
min963.531-964.803=-1.272
max963.593-964.860=-1.268
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.810-0.841=-0.031
σ0.054-0.027=0.026
min0.726-0.806=-0.080
max0.857-0.866=-0.009
name=cdr_enhanced_4k_loc.art
mean884.854-885.514=-0.660
σ0.004-0.008=-0.003
min884.847-885.504=-0.657
max884.859-885.524=-0.666
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.707-0.724=-0.016
σ0.048-0.034=0.014
min0.629-0.666=-0.037
max0.741-0.752=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=-0.000
min7.705-7.715=-0.010
max7.712-7.722=-0.010
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.226-4.255=-0.029
σ0.082-0.094=-0.012
min4.087-4.108=-0.021
max4.520-4.687=-0.167
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.199-4.229=-0.030
σ0.070-0.082=-0.012
min4.062-4.100=-0.038
max4.408-4.527=-0.119
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.742-0.746=-0.004
σ0.020-0.024=-0.004
min0.709-0.708=0.001
max0.874-0.850=0.024
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.704-0.710=-0.006
σ0.024-0.018=0.006
min0.572-0.669=-0.097
max0.779-0.775=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.514-295.583=-1.069
σ0.183-0.268=-0.086
min294.274-295.395=-1.121
max294.900-296.309=-1.409
mean1901.000-1898.000=3.000
σ0.000
min1901.000-1898.000=3.000
max1901.000-1898.000=3.000
mean0.580-0.582=-0.001
σ0.053-0.037=0.016
min0.499-0.522=-0.023
max0.673-0.668=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.490-285.417=-3.927
σ0.043-0.034=0.010
min281.440-285.371=-3.931
max281.535-285.455=-3.920
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.387-0.394=-0.007
σ0.008-0.010=-0.002
min0.378-0.381=-0.003
max0.397-0.409=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1291.491-1295.801=-4.310
σ0.123-0.113=0.009
min1291.354-1295.679=-4.324
max1291.651-1295.940=-4.290
mean1644.000
σ0.000
min1644.000
max1644.000
mean1.874-1.912=-0.037
σ0.074-0.094=-0.020
min1.799-1.808=-0.009
max1.973-2.024=-0.051
iters=5
new-facts=6402
prior-facts=1
mean1534.317-1538.634=-4.317
σ3.998-4.014=-0.017
min1532.324-1536.620=-4.295
max1541.461-1545.806=-4.346
mean1644.000
σ0.000
min1644.000
max1644.000
mean2.229-2.253=-0.024
σ0.175-0.192=-0.018
min2.027-2.026=0.001
max2.419-2.437=-0.019
iters=5
new-facts=6402
prior-facts=6402
mean1853.355-1857.702=-4.347
σ0.054-0.056=-0.001
min1853.306-1857.638=-4.333
max1853.434-1857.780=-4.346
mean1770.600-1772.600=-2.000
σ124.985-124.566=0.419
min1644.000
max1901.000-1898.000=3.000
mean3.082-3.112=-0.030
σ0.374-0.327=0.047
min2.829-2.881=-0.052
max3.732-3.684=0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.308-1.390=-0.082
σ0.299-0.275=0.024
min1.096-1.112=-0.015
max1.821-1.840=-0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-444.060=-1.631
σ577.064-577.574=-0.510
min153.896-155.271=-1.375
max1308.026-1310.422=-2.396
mean96.250
σ8.500
min92.000
max109.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.532-0.561=-0.028
σ0.550-0.600=-0.050
min0.255-0.256=-0.001
max1.357-1.461=-0.103
policies=20
mean1539.226-1552.985=-13.759
σ0.326-0.325=0.001
min1539.003-1552.755=-13.753
max1539.711-1553.467=-13.757
mean920.000
σ0.000
min920.000
max920.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean2.585-2.587=-0.002
σ0.019-0.019=0.000
min2.567-2.564=0.002
max2.612-2.605=0.007
policies=200
mean15400.445-15537.956=-137.511
σ0.076-0.070=0.006
min15400.352-15537.887=-137.535
max15400.536-15538.030=-137.494
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000
σ0.000
min1644.000
max1644.000
mean26.016-26.142=-0.126
σ0.091-0.120=-0.029
min25.951-26.047=-0.096
max26.150-26.315=-0.164