Compare commits

Home / Compare 121a2dfa .. f3fc2c86

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-53.699=0.332
σ0.369-0.367=0.002
min53.887-53.555=0.332
max55.081-54.744=0.337
mean413.000
σ0.000
min413.000
max413.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.129-0.131=-0.002
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.385-43.058=0.326
σ0.007-0.007=-0.000
min43.375-43.048=0.326
max43.399-43.069=0.330
mean413.000
σ0.000
min413.000
max413.000
mean0.122-0.121=0.000
σ0.004-0.007=-0.002
min0.115-0.115=0.000
max0.128-0.135=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1005.105=1.226
σ0.908-0.892=0.016
min1005.859-1004.643=1.216
max1010.101-1008.805=1.296
mean1048.450-1060.800=-12.350
σ310.744-328.456=-17.712
min552.000-549.000=3.000
max1646.000-1629.000=17.000
mean1.543-1.632=-0.089
σ0.093-0.079=0.014
min1.460-1.560=-0.100
max1.820-1.851=-0.031

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=0.000
min0.881
max0.887-0.886=0.001
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.437-0.423=0.014
σ0.126-0.137=-0.011
min0.347-0.338=0.009
max0.651-0.664=-0.013
name=error_case.art
mean2.335-2.333=0.002
σ0.003-0.003=0.000
min2.332
max2.337
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.876-0.885=-0.010
σ0.090-0.088=0.002
min0.815-0.831=-0.016
max1.034-1.039=-0.005
name=heavy_item.art
mean1.521-1.521=-0.000
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.538-0.545=-0.007
σ0.048-0.044=0.003
min0.508-0.512=-0.004
max0.622-0.621=0.001
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.844-0.836=0.009
σ0.032-0.033=-0.002
min0.822-0.806=0.016
max0.899-0.892=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.553=-0.002
σ0.025-0.037=-0.012
min963.523-963.531=-0.008
max963.583-963.618=-0.035
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.832-0.817=0.015
σ0.028-0.032=-0.004
min0.800-0.773=0.026
max0.866-0.860=0.005
name=cdr_enhanced_4k_loc.art
mean884.856-884.853=0.002
σ0.007-0.009=-0.002
min884.847
max884.863-884.866=-0.003
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.726-0.723=0.003
σ0.037-0.025=0.012
min0.660-0.684=-0.025
max0.750-0.743=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.709
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean4.216-4.280=-0.064
σ0.084-0.086=-0.001
min4.097-4.138=-0.042
max4.540-4.567=-0.027
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean4.221-4.245=-0.024
σ0.078-0.079=-0.001
min4.037-4.093=-0.056
max4.463-4.555=-0.092
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.744-0.751=-0.007
σ0.015-0.016=-0.001
min0.707-0.726=-0.019
max0.834-0.853=-0.019
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.705-0.711=-0.006
σ0.016-0.014=0.002
min0.681-0.675=0.006
max0.789-0.773=0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.489-294.150=1.339
σ0.256-0.217=0.040
min295.304-293.955=1.349
max296.201-294.719=1.482
mean1906.000-1903.000=3.000
σ0.000
min1906.000-1903.000=3.000
max1906.000-1903.000=3.000
mean0.568-0.580=-0.012
σ0.052-0.029=0.022
min0.499-0.523=-0.023
max0.637-0.619=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.248-281.495=3.753
σ0.041-0.037=0.004
min285.198-281.447=3.751
max285.289-281.533=3.756
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.393-0.391=0.002
σ0.009-0.009=-0.000
min0.384-0.384=-0.000
max0.401-0.404=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.203-1291.475=3.728
σ0.112-0.107=0.005
min1295.077-1291.359=3.718
max1295.327-1291.628=3.700
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean1.895-1.900=-0.005
σ0.088-0.086=0.002
min1.812-1.817=-0.006
max2.022-1.992=0.030
iters=5
new-facts=6402
prior-facts=1
mean1538.081-1534.337=3.744
σ4.008-4.049=-0.041
min1536.108-1532.272=3.836
max1545.243-1541.571=3.673
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean2.188-2.277=-0.089
σ0.132-0.310=-0.178
min2.026-2.028=-0.002
max2.316-2.797=-0.480
iters=5
new-facts=6402
prior-facts=6402
mean1857.112-1853.354=3.758
σ0.052-0.052=0.001
min1857.052-1853.294=3.758
max1857.180-1853.424=3.755
mean1776.000-1769.600=6.400
σ128.792-129.038=-0.246
min1646.000-1629.000=17.000
max1906.000-1903.000=3.000
mean3.111-2.984=0.128
σ0.377-0.208=0.169
min2.853-2.783=0.069
max3.769-3.326=0.443

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.366-1.516=-0.150
σ0.263-0.213=0.050
min1.110-1.265=-0.154
max1.796-1.837=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-442.428=1.182
σ577.065-577.065=0.001
min155.075-153.893=1.182
max1309.209-1308.025=1.183
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean0.539-0.515=0.024
σ0.562-0.518=0.045
min0.258-0.250=0.008
max1.382-1.291=0.091
policies=20
mean1551.051-1539.234=11.817
σ0.340-0.336=0.004
min1550.821-1539.003=11.818
max1551.557-1539.734=11.823
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean2.605-2.595=0.010
σ0.012-0.022=-0.010
min2.590-2.572=0.018
max2.618-2.615=0.003
policies=200
mean15518.514-15400.474=118.040
σ0.060-0.113=-0.053
min15518.462-15400.396=118.066
max15518.574-15400.639=117.935
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1629.000=17.000
σ0.000
min1646.000-1629.000=17.000
max1646.000-1629.000=17.000
mean26.177-26.021=0.156
σ0.158-0.084=0.074
min26.053-25.940=0.112
max26.388-26.132=0.257