Hadoop File System (CSV) tab

Use the Hadoop File System (CSV) tab to specify processing options for converting to HDFS CSV format and to enter file names for object-specific target files. The tab displays when you select the Hadoop File System CSV format for the converted file.

Example of the Hadoop File System (CSV) tab, described as follows.
Macro Options
Use a file macro to create unique files names for each table that is shown in the object grid.
Use File Macro
Select this check box to use a macro to create unique files for each table that is shown in the grid.
Macro
Specify the name of the Optim™ macro to be used to generate the unique file names. For example: Specify the $OBJNAME macro to generate a file name that includes the name of the table or view. For details on using Optim macros to generate file names, refer to the Common Elements Manual, Appendix A. Enhanced File Names.
Hadoop Options
Click to open to HDFS Comma Separated Value (CSV) Options dialog and enter processing options for the converted files.
Object grid
Use the grid to specify object-specific target files. The grid is populated only if a Table Map is specified.
Object Name
The names of the tables or views for the converted file.
File Location
Name of the unique file to be created for this table or view. If you do not specify a fully qualified path for the file, the Optim solution uses the directory that is specified in the Destination File field on the General tab. If you do not specify a file name for an object, the converted data is written to the file specified in the Destination File field on the General tab. If you specified file macros, Optim uses the macros to create unique file names for objects with blank cells in this column.

Hadoop Options dialog

Use the Hadoop Options dialog to enter processing options for the converted HDFS format files.

Example of the Hadoop Options dialog, described as follows.
Meta Data Options
Options to include column names at the beginning of the first record for a table.
Generate Meta Data
Select this check box to use the metadata options.
Beginning Label
A 1-10 character label to be prefixed before the first column name.
End Label
A 1-10 character label to be suffixed after the last column name.
Header Delimiter
Character to be used to separate column names. Specify a single character. The default is a dash (-).
Field Delimiter
This parameter is required. Specify a single character to separate column values. The default is a comma (,).
Escape Character
Specify a single character to be prepended to any string column values. If you specify an escape character, Optim scans all character data. There is no default.
Note: Use caution before you specify an escape character, as scanning all character data imposes significant impact on processing.
String Delimiter
Character to delimit string column values. There is no default.
LOB/XML Options
Options for handling LOB or XML columns.
Include LOB/XML Columns
Select this check box to create a separate file for each LOB or XML column in each row.
LOB/XML Directory
Fully qualified path to the directory for the LOB/XML column files.
Null Field Options
Options for null values.
Use Null Field Value
Select this check box to replace null values with a string.
Null Field Value
Specify a 1-15 character string to be used as a replacement for a null value.


Feedback