Kavaliro
http://www.kavaliro.com
http://www.kavaliro.com
Hadoop Developer - 6+ month contract
Experience on core java, oops concepts, multithreading, collection framework. Hands on Spark as well as experience with building stream-processing solutions such as Storm or Spark-Streaming.
- Hive Queries
- Big Data querying tools: Pig, Hive and Impala
- Creating views on hive tables
REQUIREMENTS:
- Proficiency with Hadoop v2, MapReduce, HDFS
- Partitioning
- Writing and reading data on hdfs like to and form csv or parquate file
- In-depth knowledge & experience with Hadoop ecosystem & architecture (including HDFS & YARN) across multiple distros.
OTHER:
- Experience with various messaging- Kafka or RabbitMQ
- Knowledge of various ETL techniques and frameworks, such as Flume
- Ability to work with huge volumes of data
- Cloudera resource management like yarn
- Knowledge of GitHub, TeamCity, Sonar
- Agile/Scrum
Data Developer
1000 Harbor Blvd Weehawken, NJ 07086
Posted: 11/15/2018
2018-12-03
2019-03-22
Industry: Other Area(s)
Job Number: 32492
Hadoop Developer - 6+ month contract
Experience on core java, oops concepts, multithreading, collection framework. Hands on Spark as well as experience with building stream-processing solutions such as Storm or Spark-Streaming.
- Hive Queries
- Big Data querying tools: Pig, Hive and Impala
- Creating views on hive tables
REQUIREMENTS:
- Proficiency with Hadoop v2, MapReduce, HDFS
- Partitioning
- Writing and reading data on hdfs like to and form csv or parquate file
- In-depth knowledge & experience with Hadoop ecosystem & architecture (including HDFS & YARN) across multiple distros.
OTHER:
- Experience with various messaging- Kafka or RabbitMQ
- Knowledge of various ETL techniques and frameworks, such as Flume
- Ability to work with huge volumes of data
- Cloudera resource management like yarn
- Knowledge of GitHub, TeamCity, Sonar
- Agile/Scrum