Use the Hadoop connector to process and store big data.
Integrating your application with Hadoop lets you use these operations in an automation. It exposes 8 actions, listed below. Add the connector from the Connections area, authenticate, then select its operations in the automation builder. Capabilities: actions.
Authentication
Before you begin, make sure you have the following information:
Connection Name: Choose a meaningful name for your connection. This name helps you identify the connection within your application or integration settings.
Authentication Type: The authentication method for this connector is defined in the connection setup. Select the connector in the Connections area to see the fields it requires.
Actions
Action Name | Description |
|---|---|
Append to file | Appends to a file in Hadoop |
Create directory | Creates a directory in Hadoop |
Create file | Creates and writes to a file in Hadoop |
Delete file or directory | Deletes a file or a directory in Hadoop |
Export via Sqoop | Export data from HDFS to a relational database using Apache Sqoop |
List directories | Lists directories in Hadoop |
Open file | Opens or reads a file in Hadoop |
Read parquet metadata | Read parquet file metadata in Hadoop |