Compare commits

Home / Compare 492a8f3d .. 4ac002c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.370-0.370=0.000
min53.870-53.869=0.001
max55.069-55.068=0.001
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.137-0.136=0.000
σ0.006-0.003=0.002
min0.130-0.131=-0.001
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.000
σ0.007-0.006=0.001
min43.311-43.315=-0.004
max43.335-43.332=0.003
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.122-0.121=0.002
σ0.004-0.005=-0.001
min0.119-0.115=0.004
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.311=-0.006
σ1.181-1.171=0.011
min1005.769-1005.741=0.028
max1011.257-1011.213=0.044
mean1062.950-1057.300=5.650
σ316.002-317.459=-1.456
min595.000-568.000=27.000
max1636.000-1632.000=4.000
mean1.555-1.544=0.011
σ0.078-0.049=0.029
min1.474-1.487=-0.012
max1.780-1.663=0.117

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.417-0.420=-0.002
σ0.150-0.143=0.007
min0.334-0.334=-0.001
max0.685-0.674=0.010
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.890-0.890=0.000
σ0.091-0.096=-0.005
min0.828-0.818=0.010
max1.048-1.056=-0.008
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.549-0.543=0.006
σ0.046-0.047=-0.001
min0.509-0.509=0.000
max0.620-0.620=-0.000
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.865-0.853=0.012
σ0.032-0.040=-0.008
min0.834-0.825=0.009
max0.918-0.921=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.114=0.001
σ0.033-0.033=0.000
min964.086
max964.169-964.169=0.000
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.828-0.819=0.009
σ0.042-0.052=-0.010
min0.762-0.730=0.032
max0.862-0.859=0.003
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.008-0.008=0.000
min884.705-884.703=0.001
max884.724-884.722=0.001
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.726-0.710=0.016
σ0.021-0.032=-0.010
min0.689-0.668=0.021
max0.739-0.741=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.002
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean4.202-3.544=0.658
σ0.080-0.081=-0.002
min4.088-3.368=0.720
max4.618-3.924=0.694
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.668=-0.002
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean4.207-3.524=0.683
σ0.067-0.068=-0.002
min4.072-3.320=0.752
max4.404-3.688=0.717
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.736-0.741=-0.005
σ0.018-0.018=0.000
min0.707-0.706=0.001
max0.842-0.846=-0.004
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.697-0.697=-0.000
σ0.016-0.017=-0.001
min0.667-0.666=0.001
max0.806-0.781=0.025

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.137-296.075=0.062
σ0.263-0.207=0.056
min295.969-295.930=0.040
max296.866-296.644=0.222
mean1908.000-1950.000=-42.000
σ0.000
min1908.000-1950.000=-42.000
max1908.000-1950.000=-42.000
mean0.581-0.563=0.018
σ0.039-0.031=0.008
min0.516-0.504=0.011
max0.651-0.598=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.704-284.694=0.011
σ0.029-0.035=-0.006
min284.678-284.650=0.028
max284.738-284.739=-0.001
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.397-0.396=0.001
σ0.012-0.008=0.004
min0.384-0.387=-0.003
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.057=0.022
σ0.109-0.123=-0.014
min1294.950-1294.950=-0.000
max1295.209-1295.264=-0.054
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean1.900-1.940=-0.040
σ0.111-0.165=-0.054
min1.803-1.826=-0.023
max2.049-2.231=-0.181
iters=5
new-facts=6402
prior-facts=1
mean1539.191-1539.210=-0.019
σ6.847-6.850=-0.003
min1535.929-1535.943=-0.014
max1551.435-1551.460=-0.024
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean2.257-2.265=-0.008
σ0.234-0.193=0.041
min2.076-2.110=-0.034
max2.623-2.560=0.063
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.984=0.004
σ0.053-0.056=-0.002
min1856.941-1856.923=0.017
max1857.071-1857.062=0.009
mean1774.600-1750.000=24.600
σ131.722-130.859=0.864
min1636.000-1632.000=4.000
max1908.000-1950.000=-42.000
mean2.997-3.021=-0.024
σ0.308-0.323=-0.014
min2.756-2.820=-0.064
max3.534-3.591=-0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.237-1.200=0.037
σ0.277-0.270=0.007
min0.938-0.935=0.004
max1.537-1.639=-0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.785=0.002
σ581.212-581.212=0.000
min157.179-157.176=0.002
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean0.524-0.531=-0.007
σ0.514-0.555=-0.041
min0.260-0.234=0.026
max1.296-1.364=-0.068
policies=20
mean1572.100-1572.084=0.016
σ0.345-0.350=-0.005
min1571.865-1571.848=0.017
max1572.613-1572.604=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean2.612-2.620=-0.007
σ0.014-0.024=-0.010
min2.602-2.592=0.010
max2.633-2.641=-0.008
policies=200
mean15729.079-15729.012=0.067
σ0.075-0.097=-0.021
min15729.031-15728.876=0.154
max15729.191-15729.104=0.086
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1632.000=4.000
σ0.000
min1636.000-1632.000=4.000
max1636.000-1632.000=4.000
mean26.452-26.580=-0.128
σ0.033-0.206=-0.173
min26.416-26.429=-0.013
max26.489-26.882=-0.393