Compare commits

Home / Compare f73bb643 .. d0549aad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.031=0.001
σ0.368-0.369=-0.000
min53.882-53.886=-0.005
max55.079-55.079=-0.000
mean414.000-414.700=-0.700
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.139-0.139=0.001
σ0.003-0.004=-0.000
min0.136-0.133=0.003
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.006-0.006=0.000
min43.374-43.374=0.000
max43.396-43.392=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.123-0.123=0.000
σ0.003-0.004=-0.002
min0.120-0.119=0.001
max0.128-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.330-1006.334=-0.004
σ0.889-0.873=0.015
min1005.833-1005.836=-0.002
max1010.023-1009.951=0.071
mean1048.200-1055.600=-7.400
σ306.607-316.757=-10.150
min572.000-564.000=8.000
max1642.000-1620.000=22.000
mean1.540-1.554=-0.014
σ0.082-0.075=0.007
min1.468-1.480=-0.012
max1.814-1.763=0.051

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.407-0.418=-0.011
σ0.133-0.128=0.006
min0.332-0.337=-0.005
max0.644-0.645=-0.000
name=error_case.art
mean2.334-2.334=0.000
σ0.003-0.004=-0.001
min2.332
max2.337-2.340=-0.002
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.871-0.879=-0.008
σ0.088-0.080=0.008
min0.794-0.822=-0.028
max1.022-1.020=0.002
name=heavy_item.art
mean1.521-1.521=-0.000
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.540-0.542=-0.002
σ0.047-0.059=-0.013
min0.489-0.497=-0.008
max0.611-0.639=-0.028
name=nested_use.art
mean2.357-2.355=0.001
σ0.002-0.002=0.000
min2.355-2.355=0.000
max2.358
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.832-0.840=-0.008
σ0.043-0.036=0.007
min0.793-0.811=-0.018
max0.900-0.898=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.555-963.552=0.003
σ0.031-0.024=0.007
min963.523-963.524=-0.001
max963.601-963.583=0.018
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.831-0.834=-0.003
σ0.045-0.036=0.008
min0.751-0.781=-0.030
max0.856-0.865=-0.009
name=cdr_enhanced_4k_loc.art
mean884.857-884.856=0.001
σ0.004-0.009=-0.005
min884.851-884.847=0.004
max884.860-884.867=-0.006
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.721-0.696=0.025
σ0.031-0.031=0.000
min0.674-0.660=0.014
max0.746-0.741=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.002
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean4.235-4.273=-0.038
σ0.087-0.094=-0.007
min4.094-4.146=-0.053
max4.542-4.604=-0.062
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean4.181-4.240=-0.059
σ0.061-0.086=-0.025
min4.084-4.103=-0.019
max4.447-4.499=-0.052
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.746-0.746=0.001
σ0.016-0.018=-0.001
min0.716-0.720=-0.004
max0.851-0.862=-0.011
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.705-0.712=-0.007
σ0.017-0.022=-0.005
min0.636-0.630=0.006
max0.793-0.802=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.488-295.525=-0.037
σ0.213-0.227=-0.013
min295.297-295.355=-0.057
max296.044-296.135=-0.091
mean1904.000-1910.000=-6.000
σ0.000
min1904.000-1910.000=-6.000
max1904.000-1910.000=-6.000
mean0.573-0.573=0.000
σ0.026-0.062=-0.036
min0.521-0.505=0.016
max0.600-0.715=-0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.246-285.241=0.005
σ0.032-0.035=-0.003
min285.206-285.188=0.018
max285.288-285.283=0.005
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.393-0.391=0.002
σ0.011-0.009=0.002
min0.381-0.381=-0.000
max0.406-0.399=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.209-1295.196=0.013
σ0.114-0.105=0.009
min1295.082-1295.078=0.004
max1295.351-1295.311=0.040
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean1.884-1.937=-0.053
σ0.097-0.141=-0.044
min1.771-1.785=-0.014
max2.016-2.138=-0.122
iters=5
new-facts=6402
prior-facts=1
mean1538.080-1538.118=-0.038
σ4.007-3.989=0.018
min1536.104-1536.094=0.010
max1545.241-1545.243=-0.003
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean2.205-2.356=-0.152
σ0.163-0.236=-0.073
min2.031-2.020=0.011
max2.390-2.678=-0.287
iters=5
new-facts=6402
prior-facts=6402
mean1857.110-1857.106=0.003
σ0.052-0.047=0.006
min1857.060-1857.060=-0.000
max1857.187-1857.170=0.017
mean1773.200-1766.600=6.600
σ129.783-139.236=-9.453
min1642.000-1620.000=22.000
max1904.000-1910.000=-6.000
mean3.029-3.091=-0.062
σ0.376-0.314=0.062
min2.653-2.862=-0.209
max3.657-3.642=0.015

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.343-1.398=-0.055
σ0.289-0.320=-0.031
min1.106-1.114=-0.008
max1.810-1.834=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.611=-0.001
σ577.065-577.065=0.000
min155.077-155.076=0.000
max1309.208-1309.208=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean0.533-0.510=0.023
σ0.550-0.498=0.053
min0.257-0.259=-0.002
max1.359-1.257=0.102
policies=20
mean1551.037-1551.052=-0.014
σ0.309-0.333=-0.024
min1550.820-1550.824=-0.004
max1551.495-1551.547=-0.051
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean2.559-2.586=-0.028
σ0.009-0.015=-0.006
min2.551-2.571=-0.020
max2.568-2.606=-0.038
policies=200
mean15518.733-15518.730=0.003
σ0.078-0.099=-0.021
min15518.683-15518.635=0.048
max15518.848-15518.862=-0.014
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1620.000=22.000
σ0.000
min1642.000-1620.000=22.000
max1642.000-1620.000=22.000
mean26.180-26.127=0.053
σ0.146-0.176=-0.029
min26.005-26.005=0.000
max26.306-26.378=-0.071