Compare commits

Home / Compare df21bc6d .. 448177d1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=0.000
σ0.370-0.368=0.002
min53.904-53.910=-0.006
max55.107-55.101=0.006
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.141-0.141=0.000
σ0.006-0.004=0.001
min0.136-0.135=0.000
max0.152-0.148=0.005
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.001
σ0.007-0.006=0.001
min43.383-43.385=-0.002
max43.407-43.402=0.005
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.122-0.122=0.000
σ0.004-0.004=-0.000
min0.119-0.116=0.002
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.005=-0.000
σ1.187-1.199=-0.012
min1006.433-1006.439=-0.007
max1011.983-1012.035=-0.052
mean1049.800-1055.300=-5.500
σ307.983-309.411=-1.428
min577.000-579.000=-2.000
max1639.000-1653.000=-14.000
mean1.531-1.534=-0.002
σ0.080-0.081=-0.001
min1.457-1.452=0.005
max1.777-1.771=0.006

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.425-0.416=0.009
σ0.144-0.125=0.019
min0.344-0.342=0.002
max0.681-0.636=0.045
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.969-0.877=0.092
σ0.194-0.092=0.103
min0.849-0.820=0.029
max1.307-1.035=0.272
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.536-0.540=-0.004
σ0.047-0.049=-0.002
min0.501-0.504=-0.003
max0.615-0.620=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.845-0.836=0.009
σ0.033-0.047=-0.014
min0.817-0.796=0.020
max0.901-0.910=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.034-0.023=0.011
min964.811-964.818=-0.008
max964.894-964.876=0.018
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.823-0.826=-0.003
σ0.038-0.038=0.000
min0.770-0.781=-0.012
max0.863-0.873=-0.010
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.008-0.007=0.001
min885.504
max885.523-885.521=0.002
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.742-0.695=0.046
σ0.011-0.051=-0.040
min0.727-0.633=0.094
max0.752-0.742=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.720=0.000
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean4.238-3.552=0.686
σ0.094-0.088=0.006
min4.089-3.369=0.720
max4.668-3.831=0.837
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean4.241-3.549=0.691
σ0.067-0.070=-0.004
min4.116-3.421=0.695
max4.401-3.812=0.589
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.755-0.539=0.216
σ0.020-0.013=0.006
min0.718-0.515=0.202
max0.869-0.614=0.255
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.705-0.512=0.193
σ0.049-0.011=0.038
min0.505-0.485=0.020
max0.776-0.559=0.217

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.939-296.841=0.098
σ0.200-0.248=-0.048
min296.772-296.661=0.111
max297.446-297.503=-0.058
mean1928.000-1902.000=26.000
σ0.000
min1928.000-1902.000=26.000
max1928.000-1902.000=26.000
mean0.570-0.601=-0.031
σ0.042-0.032=0.010
min0.503-0.568=-0.064
max0.637-0.682=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.824=-0.006
σ0.041-0.034=0.007
min286.774-286.782=-0.008
max286.868-286.867=0.001
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.400-0.401=-0.001
σ0.006-0.013=-0.007
min0.391-0.390=0.001
max0.405-0.419=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1297.253-1297.226=0.027
σ0.048-0.074=-0.026
min1297.199-1297.143=0.056
max1297.305-1297.327=-0.022
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean2.163-2.079=0.084
σ0.092-0.065=0.027
min2.036-2.014=0.022
max2.287-2.174=0.113
iters=5
new-facts=6402
prior-facts=1
mean1541.352-1541.396=-0.044
σ6.823-6.823=0.001
min1538.131-1538.199=-0.069
max1553.554-1553.598=-0.043
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean2.312-2.397=-0.086
σ0.168-0.175=-0.007
min2.129-2.139=-0.010
max2.524-2.542=-0.018
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.117=-0.002
σ0.078-0.063=0.015
min1858.998-1859.040=-0.042
max1859.193-1859.193=0.000
mean1786.400-1773.000=13.400
σ142.047-123.219=18.828
min1639.000-1653.000=-14.000
max1928.000-1902.000=26.000
mean3.138-3.080=0.058
σ0.328-0.264=0.064
min2.867-2.789=0.078
max3.636-3.420=0.216

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.219-1.184=0.036
σ0.335-0.352=-0.017
min0.942-0.926=0.017
max1.758-1.763=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.820=0.002
σ581.372-581.372=0.001
min158.134-158.133=0.002
max1320.880-1320.877=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean0.541-0.537=0.004
σ0.543-0.551=-0.008
min0.269-0.259=0.010
max1.355-1.364=-0.009
policies=20
mean1581.626-1581.609=0.016
σ0.352-0.357=-0.004
min1581.389-1581.369=0.020
max1582.150-1582.140=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean2.628-2.633=-0.005
σ0.017-0.013=0.004
min2.610-2.620=-0.010
max2.649-2.650=-0.001
policies=200
mean15824.159-15824.211=-0.053
σ0.167-0.147=0.020
min15824.049-15824.075=-0.026
max15824.407-15824.416=-0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1653.000=-14.000
σ0.000
min1639.000-1653.000=-14.000
max1639.000-1653.000=-14.000
mean26.641-26.600=0.041
σ0.115-0.039=0.076
min26.485-26.557=-0.072
max26.750-26.645=0.105