Compare commits

Home / Compare 18c809a9 .. e0567662

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.012=0.002
σ0.368-0.369=-0.001
min53.868-53.872=-0.003
max55.062-55.063=-0.001
mean413.700-416.000=-2.300
σ0.483-0.000=0.483
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.139-0.139=-0.001
σ0.004-0.005=-0.001
min0.135-0.134=0.001
max0.145-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.006=0.001
min43.314-43.312=0.002
max43.333-43.333=-0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.121-0.121=0.000
σ0.004-0.005=-0.001
min0.118-0.114=0.004
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.317-1006.312=0.004
σ1.153-1.160=-0.007
min1005.744-1005.762=-0.017
max1011.129-1011.164=-0.036
mean1046.100-1047.150=-1.050
σ314.234-313.716=0.518
min577.000-596.000=-19.000
max1643.000-1645.000=-2.000
mean1.557-1.567=-0.010
σ0.080-0.094=-0.014
min1.479-1.478=0.001
max1.780-1.804=-0.024

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.406-0.419=-0.013
σ0.139-0.141=-0.002
min0.316-0.325=-0.010
max0.652-0.661=-0.008
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.884-0.863=0.021
σ0.084-0.087=-0.003
min0.829-0.797=0.032
max1.033-1.014=0.018
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.534-0.534=-0.001
σ0.051-0.048=0.004
min0.479-0.498=-0.019
max0.613-0.618=-0.006
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.835-0.824=0.012
σ0.047-0.041=0.006
min0.793-0.798=-0.005
max0.915-0.891=0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.001
σ0.033-0.034=-0.001
min964.084-964.085=-0.001
max964.169-964.170=-0.001
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.844-0.812=0.032
σ0.017-0.047=-0.029
min0.815-0.735=0.081
max0.861-0.850=0.012
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=0.000
σ0.008-0.007=0.000
min884.703
max884.723-884.722=0.001
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.698-0.694=0.005
σ0.059-0.057=0.002
min0.597-0.601=-0.005
max0.739-0.741=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.003
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean4.242-4.233=0.009
σ0.083-0.094=-0.011
min4.123-4.091=0.033
max4.625-4.531=0.094
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean4.221-4.182=0.039
σ0.061-0.069=-0.008
min4.104-4.066=0.038
max4.370-4.494=-0.123
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.735-0.733=0.003
σ0.021-0.019=0.002
min0.707-0.698=0.009
max0.849-0.857=-0.009
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.690-0.695=-0.005
σ0.018-0.015=0.003
min0.605-0.666=-0.061
max0.761-0.779=-0.019

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.290-296.194=0.096
σ0.236-0.268=-0.033
min296.022-296.041=-0.019
max296.791-296.951=-0.160
mean1942.000-1897.000=45.000
σ0.000
min1942.000-1897.000=45.000
max1942.000-1897.000=45.000
mean0.574-0.558=0.016
σ0.034-0.038=-0.005
min0.511-0.503=0.008
max0.608-0.597=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.697=-0.001
σ0.036-0.035=0.001
min284.652-284.653=-0.001
max284.737-284.740=-0.003
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.402-0.398=0.004
σ0.013-0.011=0.002
min0.385-0.385=-0.000
max0.421-0.407=0.015
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.087=-0.007
σ0.113-0.121=-0.007
min1294.962-1294.960=0.002
max1295.222-1295.239=-0.017
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean1.909-1.915=-0.007
σ0.097-0.097=-0.000
min1.804-1.798=0.006
max1.994-1.999=-0.005
iters=5
new-facts=6402
prior-facts=1
mean1539.181-1539.179=0.001
σ6.861-6.838=0.023
min1535.940-1535.877=0.063
max1551.451-1551.407=0.044
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean2.265-2.281=-0.015
σ0.260-0.229=0.031
min2.016-2.026=-0.010
max2.577-2.514=0.063
iters=5
new-facts=6402
prior-facts=6402
mean1856.987-1856.984=0.003
σ0.057-0.057=0.000
min1856.924-1856.931=-0.007
max1857.055-1857.067=-0.012
mean1788.200-1769.200=19.000
σ149.809-122.316=27.493
min1643.000-1645.000=-2.000
max1942.000-1897.000=45.000
mean3.061-3.057=0.004
σ0.182-0.271=-0.088
min2.808-2.840=-0.032
max3.318-3.519=-0.200

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.265-1.214=0.050
σ0.276-0.324=-0.048
min1.060-0.937=0.123
max1.581-1.756=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.787=-0.002
σ581.212-581.212=-0.000
min157.178-157.179=-0.002
max1319.602-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.542-0.539=0.003
σ0.565-0.549=0.016
min0.258-0.263=-0.005
max1.390-1.363=0.027
policies=20
mean1572.089-1572.100=-0.011
σ0.358-0.348=0.010
min1571.848-1571.865=-0.017
max1572.621-1572.617=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean2.628-2.615=0.013
σ0.018-0.011=0.006
min2.611-2.603=0.009
max2.652-2.627=0.025
policies=200
mean15729.016-15729.075=-0.059
σ0.131-0.064=0.067
min15728.866-15729.029=-0.163
max15729.183-15729.167=0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean26.464-26.476=-0.012
σ0.018-0.046=-0.028
min26.449-26.427=0.022
max26.490-26.538=-0.048