Teradata Response Buffer Size
For the reader connection to source data from a Teradata database, ODBC connection is used out of the box. There is another option using piped FastExport utility connection with which there has been mixed success and will be discussed in a later blog post. OBDC can be tuned to achieve better performance in read throughput by changing the response buffer size. MaxRespSize is used to change the value in ODBC.ini. The default is 8192. The max value that can be specified is 1048576. From experience at a client site, simply specifying the max value did not help in improving the throughput. Increase the value systematically to determine the sweet spot for a network. The graph bellow illustrates throughputs achieved at different MaxRespSize values
Driver=/usr/odbc/drivers/tdata.so
Description=Teradata Linux 64-bit
DBCName=DWTESTcop1.XXXX.COM
SessionMode=Teradata
StCheckLevel=0
LastUser=
Username=
Password=
Database=
DefaultDatabase=
OutPutAsResultSet=Yes
MaxRespSize=8192