Compare commits

Home / Compare abfe2b45 .. 425e6c19

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.000
σ0.369-0.369=0.001
min53.870-53.872=-0.002
max55.065-55.064=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.140-0.135=0.005
σ0.004-0.010=-0.007
min0.137-0.129=0.009
max0.146-0.163=-0.017
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.008-0.006=0.002
min43.309-43.315=-0.006
max43.338-43.338=-0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.119-0.119=0.000
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.310=-0.004
σ1.182-1.190=-0.008
min1005.767-1005.741=0.026
max1011.260-1011.299=-0.039
mean1043.700-1051.850=-8.150
σ311.595-307.014=4.581
min596.000-586.000=10.000
max1631.000-1643.000=-12.000
mean1.575-1.504=0.071
σ0.088-0.085=0.004
min1.498-1.429=0.069
max1.834-1.716=0.119

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.406
σ0.114
min0.347
max0.610
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.889
σ0.096
min0.828
max1.056
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.550
σ0.054
min0.502
max0.643
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.850
σ0.037
min0.818
max0.911

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115
σ0.034
min964.086
max964.172
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.809
σ0.066
min0.736
max0.860
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.007
min884.705
max884.722
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.706
σ0.044
min0.648
max0.741

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1631.000
σ0.000
min1631.000
max1631.000
mean4.216
σ0.068
min4.105
max4.452
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.670
mean1631.000
σ0.000
min1631.000
max1631.000
mean4.204
σ0.064
min4.051
max4.375
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.677
σ0.098
min0.514
max0.864
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1631.000
σ0.000
min1631.000
max1631.000
mean0.501
σ0.012
min0.476
max0.563

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.464-296.353=0.111
σ0.220-0.262=-0.042
min296.324-296.195=0.128
max297.048-297.076=-0.028
mean1916.000-1944.000=-28.000
σ0.000
min1916.000-1944.000=-28.000
max1916.000-1944.000=-28.000
mean0.576-0.557=0.019
σ0.039-0.034=0.006
min0.517-0.500=0.017
max0.659-0.594=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.696=0.001
σ0.035-0.038=-0.002
min284.652-284.644=0.008
max284.738-284.741=-0.003
mean1631.000-1643.000=-12.000
σ0.000
min1631.000-1643.000=-12.000
max1631.000-1643.000=-12.000
mean0.398-0.407=-0.008
σ0.010-0.018=-0.008
min0.385-0.387=-0.002
max0.407-0.426=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.075=0.005
σ0.110-0.094=0.016
min1294.961-1294.962=-0.001
max1295.211-1295.181=0.030
mean1631.000-1643.000=-12.000
σ0.000
min1631.000-1643.000=-12.000
max1631.000-1643.000=-12.000
mean1.931-1.923=0.009
σ0.096-0.086=0.010
min1.829-1.779=0.049
max2.023-1.999=0.024
iters=5
new-facts=6402
prior-facts=1
mean1539.191-1539.190=0.001
σ6.855-6.894=-0.039
min1535.925-1535.864=0.062
max1551.450-1551.518=-0.068
mean1631.000-1643.000=-12.000
σ0.000
min1631.000-1643.000=-12.000
max1631.000-1643.000=-12.000
mean2.260-2.311=-0.050
σ0.268-0.296=-0.028
min2.028-2.118=-0.090
max2.658-2.834=-0.175
iters=5
new-facts=6402
prior-facts=6402
mean1856.987-1856.984=0.003
σ0.053-0.068=-0.015
min1856.930-1856.906=0.024
max1857.061-1857.081=-0.020
mean1771.400-1760.400=11.000
σ140.030-125.085=14.944
min1631.000-1643.000=-12.000
max1916.000-1944.000=-28.000
mean3.101-2.930=0.171
σ0.316-0.111=0.205
min2.883-2.817=0.066
max3.657-3.044=0.612

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.204=0.009
σ0.273-0.330=-0.057
min0.954-0.919=0.036
max1.652-1.753=-0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.810=-0.024
σ581.213-581.232=-0.020
min157.176-157.188=-0.012
max1319.605-1319.658=-0.054
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1643.000=-12.000
σ0.000
min1631.000-1643.000=-12.000
max1631.000-1643.000=-12.000
mean0.532-0.543=-0.011
σ0.538-0.564=-0.026
min0.261-0.258=0.004
max1.339-1.388=-0.049
policies=20
mean1572.102-1572.130=-0.028
σ0.353-0.328=0.024
min1571.868-1571.942=-0.074
max1572.626-1572.622=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1643.000=-12.000
σ0.000
min1631.000-1643.000=-12.000
max1631.000-1643.000=-12.000
mean2.629-2.622=0.007
σ0.018-0.011=0.007
min2.607-2.611=-0.004
max2.645-2.632=0.012
policies=200
mean15729.078-15729.005=0.073
σ0.107-0.061=0.046
min15728.998-15728.943=0.055
max15729.233-15729.082=0.150
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1643.000=-12.000
σ0.000
min1631.000-1643.000=-12.000
max1631.000-1643.000=-12.000
mean26.545-26.551=-0.006
σ0.033-0.148=-0.115
min26.513-26.364=0.149
max26.581-26.697=-0.116