Big Data Engineer

Chevy Chase, MD 20815

Posted: 04/24/2018 Industry: Other Area(s) Job Number: 28098

Big Data Engineer 

The Data Engineer will develop ETL/ELT jobs on the Hadoop platform using Spark and other BigData technologies

- Develop and use frameworks for data transformation

- Create and schedule jobs with Ozzie and other job coordinators

- Monitor and optimize transformation logic

- Testing and documenting results

Required Skills/ years of experience needed:

- 3 years of hands-on experience in Hadoop Eco System (HDFS AND YARN AND MapReduce AND Oozie AND Hive)

- 2 years of hands-on experience in Data Warehousing AND Data Marts AND Data/Dimensional Modeling AND ETL

- 2 year of hands-on experience in Spark core AND Spark SQL

- 5 years of hands-on programming experience in core Java

Desired Skills:

- Experience in any one of the ETL tools such as Abinitio Talend, or Kettle

- Hadoop OR NoSQL performance optimization and benchmarking using tools such as HiBench OR YCSB

- Experience on continuous build and test process using tools such as Maven AND Jenkins - Understanding of Kafka AND Spark Streaming
Apply Online
Apply with LinkedIn Apply with Facebook Apply with Twitter

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.