The Hadoop Administration will always work with facilities, network, data source, company intellect and application groups to guarantee company applications are highly available and performing within decided on service levels. It’s easy to get started with Hadoop administration because Linux system administration is a pretty well-known beast, and because systems administrators are used to administering all kinds of existing complex applications. However, there are many common missteps we’re seeing that make us believe there’s a need for some guidance in Hadoop Administration.

Provides day to day production support of our Hadoop infrastructure including:

  • Implement new Hadoop hardware infrastructure
  • OS integration and application installation
  • Cluster maintenance
  • HDFS support and maintenance
  • Adding and removing cluster nodes
  • Backup and restores
  • Troubleshooting MapReduce Jobs as required
  • Cluster Monitoring and Troubleshooting
  • Manage and review Hadoop log files
  • Filesystem management and monitoring
  • Hadoop Cluster capacity planning
  • Design, implement and maintain security
  • Manage and review data backups
  • Execute system and disaster recovery processes as required
  • Provide support and troubleshooting for BI issues associated with Hadoop
  • Provide support for legacy ETL environment as required

Work with the project and application development teams to implement new business initiatives as they relate to Hadoop Adminstartion and application teams to install operating system and Hadoop updates, patches, version upgrades as required.Implement vulnerability and operating system patches to insure compliance and system integrity.Works with business intelligence, ETL and application teams to troubleshoot complex problems that impact our customer's ability to perform required business functions.