Compare commits

Home / Compare 63389201 .. 7999088f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.055=0.001
σ0.368-0.371=-0.002
min53.914-53.913=0.002
max55.105-55.110=-0.005
mean416.000
σ0.000
min416.000
max416.000
mean0.141-0.138=0.003
σ0.005-0.005=0.001
min0.136-0.130=0.006
max0.150-0.144=0.006
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.001
σ0.006-0.006=0.000
min43.383-43.389=-0.006
max43.405-43.408=-0.004
mean416.000
σ0.000
min416.000
max416.000
mean0.119-0.119=0.000
σ0.005-0.001=0.004
min0.114-0.118=-0.004
max0.128-0.120=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1007.024=-0.048
σ0.875-1.194=-0.318
min1006.494-1006.452=0.042
max1010.608-1012.024=-1.416
mean1050.150-1048.900=1.250
σ309.631-308.298=1.333
min555.000-587.000=-32.000
max1643.000-1638.000=5.000
mean1.546-1.545=0.001
σ0.077-0.084=-0.007
min1.481-1.461=0.020
max1.784-1.814=-0.031

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.001
σ0.002-0.004=-0.001
min0.882
max0.887-0.889=-0.002
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.419-0.411=0.007
σ0.129-0.147=-0.018
min0.352-0.318=0.033
max0.647-0.672=-0.025
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.002=0.000
min2.337
max2.342
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.887-0.857=0.030
σ0.089-0.094=-0.004
min0.828-0.798=0.030
max1.041-1.020=0.022
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.527-1.526=0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.542-0.566=-0.024
σ0.049-0.063=-0.014
min0.495-0.509=-0.014
max0.625-0.657=-0.032
name=nested_use.art
mean2.362-2.362=0.001
σ0.003-0.002=0.000
min2.360
max2.366-2.365=0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.857-0.852=0.005
σ0.043-0.057=-0.015
min0.827-0.797=0.030
max0.932-0.947=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.833-964.832=0.001
σ0.028-0.027=0.001
min964.810-964.802=0.008
max964.881-964.869=0.012
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.812-0.819=-0.007
σ0.030-0.049=-0.019
min0.772-0.747=0.025
max0.856-0.860=-0.004
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.004-0.006=-0.002
min885.508-885.504=0.004
max885.518-885.519=-0.001
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.738-0.715=0.024
σ0.007-0.044=-0.036
min0.729-0.639=0.091
max0.750-0.742=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.722-7.722=-0.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean4.263-4.223=0.040
σ0.078-0.074=0.004
min4.124-4.108=0.016
max4.731-4.546=0.185
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean4.258-4.206=0.052
σ0.068-0.066=0.002
min4.116-4.097=0.019
max4.521-4.512=0.009
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.747-0.745=0.002
σ0.016-0.017=-0.000
min0.716-0.711=0.005
max0.843-0.844=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.710-0.704=0.006
σ0.016-0.025=-0.009
min0.679-0.511=0.169
max0.785-0.782=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.728-297.053=-1.324
σ0.201-0.242=-0.041
min295.569-296.886=-1.317
max296.283-297.703=-1.420
mean1980.000-1927.000=53.000
σ0.000
min1980.000-1927.000=53.000
max1980.000-1927.000=53.000
mean0.538-0.595=-0.057
σ0.031-0.026=0.005
min0.498-0.533=-0.035
max0.595-0.639=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.416-286.832=-1.415
σ0.037-0.038=-0.001
min285.376-286.784=-1.408
max285.459-286.869=-1.410
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.405-0.397=0.008
σ0.012-0.006=0.006
min0.390-0.391=-0.001
max0.422-0.405=0.017
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1297.222=-1.428
σ0.099-0.107=-0.009
min1295.675-1297.108=-1.433
max1295.897-1297.383=-1.486
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean1.936-1.901=0.035
σ0.072-0.090=-0.018
min1.877-1.810=0.067
max2.042-1.999=0.043
iters=5
new-facts=6402
prior-facts=1
mean1539.929-1541.366=-1.438
σ6.928-6.830=0.097
min1536.585-1538.102=-1.518
max1552.316-1553.582=-1.266
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.330-2.124=0.206
σ0.233-0.175=0.058
min2.062-1.957=0.106
max2.671-2.412=0.260
iters=5
new-facts=6402
prior-facts=6402
mean1857.714-1859.138=-1.425
σ0.061-0.062=-0.000
min1857.629-1859.075=-1.446
max1857.784-1859.217=-1.432
mean1783.400-1777.400=6.000
σ130.607-144.949=-14.342
min1643.000-1638.000=5.000
max1980.000-1927.000=53.000
mean2.902-2.898=0.004
σ0.073-0.116=-0.043
min2.816-2.789=0.026
max2.992-3.095=-0.103

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.337-1.347=-0.010
σ0.278-0.275=0.002
min1.105-1.107=-0.002
max1.784-1.822=-0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-448.854=-3.116
σ580.935-581.373=-0.437
min155.269-158.167=-2.899
max1317.141-1320.913=-3.772
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.535-0.551=-0.017
σ0.545-0.566=-0.020
min0.256-0.264=-0.008
max1.353-1.399=-0.047
policies=20
mean1552.971-1581.961=-28.990
σ0.320-0.362=-0.042
min1552.751-1581.723=-28.972
max1553.446-1582.499=-29.053
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.576-2.639=-0.063
σ0.010-0.009=0.001
min2.565-2.631=-0.066
max2.589-2.650=-0.061
policies=200
mean15537.976-15827.510=-289.534
σ0.152-0.154=-0.002
min15537.788-15827.290=-289.502
max15538.117-15827.650=-289.533
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean26.096-26.677=-0.581
σ0.116-0.147=-0.032
min25.993-26.556=-0.563
max26.251-26.891=-0.640