Descrição
The Hadoop Admin will have a deep understanding of Java, Hadoop / Spark / Storm / No SQL / My SQL administration, security and troubleshooting.
- The Hadoop Admin will be an outstanding communicator, creative thinker, and data nerd.
- Responsible for implementation and ongoing administration of Hadoop infrastructure Performance tuning of Big Data/ cloud environment
- Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
- Working with data delivery teams to setup new Hadoop users.
- This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users.
- Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Ambari and other tools.
- Screen Hadoop cluster job performances and capacity planning
- Monitor Hadoop cluster connectivity and security Manage and review Hadoop log les.
- File system management and monitoring. SQL (No SQL such as Mongo or Cassandra / My SQL) support and maintenance.
- Software installation and configuration.
- Database backup and recovery.
- Database connectivity and security. Disk Space Management.
- Motivated to work in startup environment.