Spark ETL Developer

Chevy Chase, MD 20815

Posted: 09/16/2019 Industry: Other Area(s) Job Number: 35731

Sr. Spark ETL Developer

-  Design needed transformations, mapping data from source to target for jobs on platform

-  Develop ETL/ELT jobs on the Hadoop platform using Spark and other BigData technologies

-  Develop and use frameworks for data transformation

-  Create and schedule jobs with Oozie and other job coordinators

-  Monitor and optimize transformation logic

-  Testing and documenting results

-  Troubleshooting and triaging problems including performance issues

-  Communicating with end customers, and teammates to work in collaborative environment (aka strong communication skills needed)

Experience in any one of the ETL tools such as Abinitio Talend, SyncSort, Informatica, SSIS, Data Stage or Kettle Experience on continuous build and test process using tools such as Gradle (or Maven) AND Jenkins Hadoop OR NoSQL performance optimization and benchmarking using tools such as HiBench OR YCSB Understanding of Kafka AND Spark Streaming
Apply Online
Apply with LinkedIn Apply with Facebook Apply with Twitter

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.