Compare commits

Home / Compare 61a3aff4 .. 5d80b09e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.368-0.370=-0.003
min53.869-53.870=-0.001
max55.061-55.069=-0.008
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.139=-0.001
σ0.004-0.005=-0.001
min0.132-0.134=-0.002
max0.144-0.146=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.325-43.321=0.004
σ0.005-0.006=-0.001
min43.319-43.311=0.008
max43.333-43.332=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.125-0.119=0.006
σ0.005-0.004=0.001
min0.119-0.114=0.005
max0.135-0.126=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.312=-0.003
σ1.175-1.156=0.019
min1005.764-1005.744=0.020
max1011.227-1011.146=0.081
mean1043.500-1048.700=-5.200
σ312.030-313.946=-1.915
min595.000-597.000=-2.000
max1633.000-1645.000=-12.000
mean1.554-1.510=0.043
σ0.078-0.085=-0.007
min1.471-1.425=0.046
max1.789-1.737=0.052

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.407
σ0.144
min0.323
max0.661
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.906
σ0.103
min0.805
max1.056
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.534
σ0.044
min0.490
max0.603
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.834
σ0.039
min0.793
max0.897

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115
σ0.035
min964.087
max964.172
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.795
σ0.033
min0.762
max0.846
name=cdr_enhanced_4k_loc.art
mean884.712
σ0.008
min884.703
max884.722
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.714
σ0.025
min0.683
max0.745

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1633.000
σ0.000
min1633.000
max1633.000
mean4.272
σ0.079
min4.140
max4.525
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1633.000
σ0.000
min1633.000
max1633.000
mean4.259
σ0.085
min4.108
max4.573
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.740
σ0.022
min0.708
max0.871
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1633.000
σ0.000
min1633.000
max1633.000
mean0.707
σ0.015
min0.678
max0.777

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.314-296.208=0.106
σ0.239-0.209=0.030
min296.131-296.076=0.055
max296.931-296.791=0.140
mean1916.000-1947.000=-31.000
σ0.000
min1916.000-1947.000=-31.000
max1916.000-1947.000=-31.000
mean0.581-0.544=0.037
σ0.042-0.031=0.010
min0.524-0.503=0.021
max0.684-0.576=0.108

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.698-284.692=0.006
σ0.029-0.030=-0.001
min284.665-284.653=0.012
max284.733-284.725=0.008
mean1633.000-1645.000=-12.000
σ0.000
min1633.000-1645.000=-12.000
max1633.000-1645.000=-12.000
mean0.397-0.396=0.001
σ0.010-0.010=-0.001
min0.386-0.384=0.002
max0.407-0.404=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.053=0.023
σ0.107-0.082=0.025
min1294.962-1294.953=0.009
max1295.206-1295.156=0.050
mean1633.000-1645.000=-12.000
σ0.000
min1633.000-1645.000=-12.000
max1633.000-1645.000=-12.000
mean1.917-1.923=-0.006
σ0.097-0.085=0.011
min1.817-1.809=0.008
max2.050-2.041=0.009
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.197=-0.011
σ6.869-6.855=0.014
min1535.935-1535.869=0.066
max1551.469-1551.455=0.014
mean1633.000-1645.000=-12.000
σ0.000
min1633.000-1645.000=-12.000
max1633.000-1645.000=-12.000
mean2.261-2.223=0.037
σ0.252-0.199=0.053
min2.016-2.058=-0.042
max2.554-2.540=0.014
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.983=0.005
σ0.054-0.072=-0.018
min1856.931-1856.914=0.017
max1857.063-1857.083=-0.020
mean1773.200-1763.000=10.200
σ138.700-125.555=13.145
min1633.000-1645.000=-12.000
max1916.000-1947.000=-31.000
mean3.088-2.941=0.147
σ0.296-0.105=0.191
min2.872-2.837=0.035
max3.599-3.064=0.535

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.116=0.110
σ0.343-0.237=0.105
min0.932-0.918=0.014
max1.807-1.465=0.343

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.804=-0.018
σ581.211-581.220=-0.009
min157.178-157.192=-0.014
max1319.602-1319.634=-0.032
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1645.000=-12.000
σ0.000
min1633.000-1645.000=-12.000
max1633.000-1645.000=-12.000
mean0.557-0.523=0.034
σ0.594-0.527=0.067
min0.260-0.259=0.000
max1.448-1.314=0.135
policies=20
mean1572.101-1572.128=-0.027
σ0.349-0.331=0.018
min1571.863-1571.943=-0.080
max1572.620-1572.624=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1645.000=-12.000
σ0.000
min1633.000-1645.000=-12.000
max1633.000-1645.000=-12.000
mean2.617-2.629=-0.011
σ0.020-0.012=0.008
min2.589-2.615=-0.026
max2.632-2.642=-0.009
policies=200
mean15729.012-15729.063=-0.051
σ0.053-0.095=-0.043
min15728.933-15728.969=-0.036
max15729.047-15729.180=-0.134
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1645.000=-12.000
σ0.000
min1633.000-1645.000=-12.000
max1633.000-1645.000=-12.000
mean26.488-26.510=-0.022
σ0.111-0.157=-0.045
min26.373-26.376=-0.003
max26.637-26.685=-0.048