Compare commits

Home / Compare b02f3237 .. 723b9047

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.042-54.042=-0.000
σ0.370-0.368=0.001
min53.894-53.899=-0.005
max55.094-55.091=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.141-0.138=0.003
σ0.005-0.005=0.000
min0.137-0.133=0.004
max0.150-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.000
σ0.006-0.006=-0.001
min43.384-43.382=0.002
max43.401-43.402=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.121-0.122=-0.001
σ0.005-0.004=0.001
min0.114-0.115=-0.000
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.338=-0.008
σ0.881-0.875=0.006
min1005.842-1005.833=0.010
max1009.981-1009.947=0.033
mean1049.600-1050.800=-1.200
σ307.607-309.746=-2.139
min573.000-556.000=17.000
max1649.000-1645.000=4.000
mean1.542-1.564=-0.022
σ0.059-0.104=-0.045
min1.484-1.475=0.009
max1.674-1.823=-0.149

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.426-0.404=0.021
σ0.134-0.108=0.026
min0.352-0.340=0.013
max0.663-0.595=0.068
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.890-0.890=-0.000
σ0.096-0.092=0.004
min0.818-0.835=-0.017
max1.052-1.052=0.001
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.542-0.552=-0.010
σ0.058-0.049=0.010
min0.488-0.507=-0.020
max0.637-0.634=0.002
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.838-0.851=-0.013
σ0.040-0.039=0.001
min0.808-0.806=0.002
max0.909-0.909=-0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.551=0.000
σ0.025-0.025=-0.000
min963.523
max963.584
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.829-0.805=0.024
σ0.040-0.041=-0.001
min0.764-0.742=0.022
max0.862-0.852=0.010
name=cdr_enhanced_4k_loc.art
mean884.856-884.857=-0.001
σ0.005-0.004=0.001
min884.848-884.851=-0.003
max884.860-884.861=-0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.666-0.711=-0.046
σ0.047-0.061=-0.014
min0.612-0.602=0.010
max0.736-0.741=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.711=-0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean4.233-3.533=0.701
σ0.068-0.074=-0.006
min4.124-3.378=0.745
max4.605-3.822=0.783
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.659-7.658=0.001
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean4.213-3.522=0.691
σ0.061-0.072=-0.010
min4.086-3.421=0.665
max4.547-3.769=0.777
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.745-0.538=0.207
σ0.018-0.014=0.005
min0.714-0.514=0.199
max0.871-0.612=0.259
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.703-0.513=0.190
σ0.038-0.011=0.028
min0.504-0.489=0.014
max0.790-0.558=0.232

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.404-295.658=-0.255
σ0.169-0.206=-0.036
min295.217-295.485=-0.269
max295.782-296.198=-0.416
mean1937.000-1892.000=45.000
σ0.000
min1937.000-1892.000=45.000
max1937.000-1892.000=45.000
mean0.574-0.575=-0.000
σ0.060-0.044=0.016
min0.504-0.501=0.003
max0.715-0.663=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.249=0.000
σ0.037-0.038=-0.001
min285.199-285.203=-0.004
max285.289-285.294=-0.005
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.387-0.397=-0.010
σ0.009-0.009=-0.001
min0.380-0.388=-0.008
max0.397-0.409=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1295.195-1295.199=-0.004
σ0.109-0.114=-0.005
min1295.076-1295.082=-0.006
max1295.324-1295.348=-0.023
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean1.928-1.925=0.002
σ0.094-0.108=-0.013
min1.826-1.801=0.025
max2.031-2.039=-0.008
iters=5
new-facts=6402
prior-facts=1
mean1539.357-1539.436=-0.079
σ6.849-6.835=0.013
min1536.105-1536.197=-0.092
max1551.605-1551.660=-0.055
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean2.202-2.405=-0.203
σ0.208-0.326=-0.118
min2.019-2.068=-0.049
max2.507-2.872=-0.365
iters=5
new-facts=6402
prior-facts=6402
mean1857.103-1857.109=-0.007
σ0.062-0.059=0.004
min1857.039-1857.050=-0.011
max1857.176-1857.193=-0.017
mean1787.800-1772.800=15.000
σ144.469-120.610=23.859
min1649.000-1645.000=4.000
max1937.000-1892.000=45.000
mean2.964-3.022=-0.057
σ0.084-0.275=-0.191
min2.831-2.691=0.140
max3.035-3.438=-0.403

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.375-1.382=-0.007
σ0.263-0.237=0.026
min1.108-1.258=-0.149
max1.757-1.805=-0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.290-445.289=0.002
σ580.424-580.424=0.000
min155.077-155.075=0.002
max1315.927-1315.925=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean0.535-0.557=-0.022
σ0.547-0.589=-0.042
min0.256-0.261=-0.005
max1.355-1.441=-0.086
policies=20
mean1551.040-1551.040=0.000
σ0.316-0.333=-0.017
min1550.826-1550.809=0.017
max1551.509-1551.534=-0.025
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean2.574-2.591=-0.017
σ0.021-0.020=0.001
min2.549-2.575=-0.026
max2.595-2.617=-0.023
policies=200
mean15518.570-15518.464=0.106
σ0.073-0.066=0.008
min15518.499-15518.388=0.111
max15518.669-15518.521=0.148
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1645.000=4.000
σ0.000
min1649.000-1645.000=4.000
max1649.000-1645.000=4.000
mean26.174-26.188=-0.015
σ0.115-0.085=0.030
min26.072-26.131=-0.059
max26.322-26.315=0.007