Compare commits

Home / Compare 3329bea1 .. ce1f7f16

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.370-0.368=0.002
min53.903-53.910=-0.007
max55.108-55.101=0.007
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.141-0.141=0.000
σ0.004-0.004=0.000
min0.134-0.135=-0.001
max0.147-0.148=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.001
σ0.006-0.006=0.000
min43.382-43.385=-0.004
max43.404-43.402=0.002
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.001
min0.114-0.116=-0.002
max0.128-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.005=-0.003
σ1.193-1.199=-0.006
min1006.445-1006.439=0.005
max1012.008-1012.035=-0.027
mean1039.550-1055.300=-15.750
σ298.301-309.411=-11.110
min582.000-579.000=3.000
max1585.000-1653.000=-68.000
mean1.530-1.534=-0.004
σ0.124-0.081=0.043
min1.330-1.452=-0.123
max1.837-1.771=0.066

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.412-0.416=-0.003
σ0.121-0.125=-0.004
min0.340-0.342=-0.002
max0.626-0.636=-0.010
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.872-0.877=-0.005
σ0.077-0.092=-0.015
min0.822-0.820=0.002
max1.006-1.035=-0.029
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.543-0.540=0.004
σ0.048-0.049=-0.000
min0.503-0.504=-0.001
max0.622-0.620=0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.846-0.836=0.010
σ0.033-0.047=-0.013
min0.816-0.796=0.020
max0.898-0.910=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.839=-0.004
σ0.029-0.023=0.006
min964.819-964.818=0.001
max964.886-964.876=0.010
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.818-0.826=-0.008
σ0.040-0.038=0.002
min0.749-0.781=-0.032
max0.849-0.873=-0.024
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.005-0.007=-0.003
min885.504
max885.515-885.521=-0.006
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.706-0.695=0.010
σ0.015-0.051=-0.036
min0.686-0.633=0.053
max0.727-0.742=-0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean4.270-3.552=0.718
σ0.078-0.088=-0.010
min4.161-3.369=0.793
max4.730-3.831=0.899
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean4.309-3.549=0.759
σ0.103-0.070=0.033
min4.172-3.421=0.751
max4.685-3.812=0.874
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.614-0.539=0.075
σ0.109-0.013=0.095
min0.515-0.515=0.000
max0.862-0.614=0.248
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.515-0.512=0.003
σ0.019-0.011=0.008
min0.492-0.485=0.006
max0.673-0.559=0.114

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.900-296.841=0.059
σ0.263-0.248=0.015
min296.725-296.661=0.064
max297.626-297.503=0.123
mean1900.000-1902.000=-2.000
σ0.000
min1900.000-1902.000=-2.000
max1900.000-1902.000=-2.000
mean0.573-0.601=-0.028
σ0.055-0.032=0.023
min0.507-0.568=-0.060
max0.695-0.682=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.824=-0.004
σ0.037-0.034=0.003
min286.769-286.782=-0.013
max286.859-286.867=-0.008
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.395-0.401=-0.006
σ0.007-0.013=-0.006
min0.387-0.390=-0.003
max0.401-0.419=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1297.212-1297.226=-0.014
σ0.069-0.074=-0.005
min1297.131-1297.143=-0.012
max1297.296-1297.327=-0.031
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean2.054-2.079=-0.025
σ0.051-0.065=-0.014
min2.004-2.014=-0.009
max2.129-2.174=-0.045
iters=5
new-facts=6402
prior-facts=1
mean1541.363-1541.396=-0.033
σ6.809-6.823=-0.014
min1538.150-1538.199=-0.050
max1553.540-1553.598=-0.057
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean2.343-2.397=-0.054
σ0.232-0.175=0.057
min2.102-2.139=-0.037
max2.700-2.542=0.158
iters=5
new-facts=6402
prior-facts=6402
mean1859.122-1859.117=0.005
σ0.067-0.063=0.005
min1859.038-1859.040=-0.003
max1859.202-1859.193=0.010
mean1758.600-1773.000=-14.400
σ141.081-123.219=17.862
min1585.000-1653.000=-68.000
max1900.000-1902.000=-2.000
mean3.020-3.080=-0.060
σ0.360-0.264=0.096
min2.714-2.789=-0.075
max3.542-3.420=0.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.279-1.184=0.095
σ0.388-0.352=0.036
min0.930-0.926=0.004
max1.866-1.763=0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.818-448.820=-0.001
σ581.373-581.372=0.001
min158.129-158.133=-0.003
max1320.878-1320.877=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean0.555-0.537=0.018
σ0.577-0.551=0.026
min0.263-0.259=0.003
max1.420-1.364=0.056
policies=20
mean1581.606-1581.609=-0.003
σ0.352-0.357=-0.004
min1581.370-1581.369=0.001
max1582.130-1582.140=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean2.635-2.633=0.002
σ0.007-0.013=-0.007
min2.630-2.620=0.010
max2.645-2.650=-0.005
policies=200
mean15824.104-15824.211=-0.108
σ0.130-0.147=-0.018
min15823.995-15824.075=-0.080
max15824.292-15824.416=-0.124
mean9200.000
σ0.000
min9200.000
max9200.000
mean1585.000-1653.000=-68.000
σ0.000
min1585.000-1653.000=-68.000
max1585.000-1653.000=-68.000
mean26.592-26.600=-0.008
σ0.051-0.039=0.011
min26.518-26.557=-0.039
max26.630-26.645=-0.015