Big Data ETL Developer

Chevy Chase, MD 20815

Posted: 07/08/2019 Industry: Other Area(s) Job Number: 34464

Job Description

Big Data ETL Developer

- Develop ETL/ELT jobs on the Hadoop platform using Spark and other BigData technologies

- Design needed transformations, mapping data from source to target for jobs on platform

- Develop and use frameworks for data transformation

- Create and schedule jobs with Oozie and other job coordinators

- Monitor and optimize transformation logic

- Testing and documenting results

- Troubleshooting and triaging problems including performance issues

- Communicating with end customers, and teammates to work in collaborative environment (aka strong communication skills needed) 


-3 years of hands-on experience in Hadoop Eco System (HDFS AND YARN AND MapReduce AND Oozie AND Hive) -AND YARN AND MapReduce AND Oozie AND Hive)

-2 years of hands-on experience in Spark core, Scala AND Spark SQL Desired skills -Experience in any one of the ETL tools such as Abinitio Talend, or Kettle

-Hadoop OR NoSQL performance optimization and benchmarking using tools such as HiBench OR YCSB

-Experience on continuous build and test process using tools such as Gradle or Maven AND Jenkins

-Understanding of Kafka AND Spark Streaming

-Experience with Graph Databases
Apply Online
Apply with LinkedIn Apply with Facebook Apply with Twitter

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.