1000 Harbor Blvd Weehawken, NJ 07086
Hadoop Developer - 6+ month contract
Experience on core java, oops concepts, multithreading, collection framework. Hands on Spark as well as experience with building stream-processing solutions such as Storm or Spark-Streaming.
- Hive Queries
- Big Data querying tools: Pig, Hive and Impala
- Creating views on hive tables
- Proficiency with Hadoop v2, MapReduce, HDFS
- Writing and reading data on hdfs like to and form csv or parquate file
- In-depth knowledge & experience with Hadoop ecosystem & architecture (including HDFS & YARN) across multiple distros.
- Experience with various messaging- Kafka or RabbitMQ
- Knowledge of various ETL techniques and frameworks, such as Flume
- Ability to work with huge volumes of data
- Cloudera resource management like yarn
- Knowledge of GitHub, TeamCity, Sonar