logo

Sydney

IT Jobs

Want to work in USA on E3 visa as Hadoop Developer

Sydney, New South Wales - 07 Oct, 2017
  • Great Logics
  • Contract
  • Want to work in USA on E3 visa as Hadoop Developer
  • Image

Skills

  • hadoop (Expert)

Description

Job Description

SOFT's client located in New York, NY is looking for a Senior Hadoop Developer for a long term contract assignment. The selected candidate will Work as a senior developer for the Hadoop enterprise data platform. Develop common components for big data platforms related to data ingestion, storage, transformations and analytics. Validate and test the data components and ensure they meet the functional and non-functional requirements. Ensure the unit of code and design follow reference architecture standards. Provide sandbox functionality to users of the datasets to build models for analysis. The top Required Technical Skills:
1. 3 - 5 years of Java programming
2. 2 years of Hadoop ecosystem, - preferably Cloudera
3. 2 years of Impala
4. 2 years of Hive
5. 2 years of any scripting language experience in the Hadoop ecosystem e.g. Python/ Scala / Spark

Required Skills:
• 8-10 years of overall experience in Information Technology and Systems
• 2+ years of experience with Big data distribution and analytics, preferably in Cloudera Ecosystem. The must consist of hands-on experience with a full project life-cycle implementation with the following features:

o data volumes in terabytes with vertical and horizontal scalability
o structured and unstructured/semi-structured data
o High speed querying
o Analytics use cases including in-memory processing
o Highly secure system
o Metadata management
• 2+ years of experience in data modeling, relational and dimensional
• 5 years of experience in multiple relational database systems (SQL Server, Oracle, DB2)
• Experience with high volume systems

Programming skills:
Java -3 to 5 years, Scala/Python/or other scripting – 2 years, Impala – 2 years, Hive-2 years, Avro/Parquet – 1 year.
• Working experience in data architecture using industry best practices
• Strong verbal, presentation, and written communication skills
• Strong initiative, ability to self-manage, and also work in a team environment

Preferred Skills:
• Experience in Cloudera distributed system
• Experience in Spark, Sqoop, Flume, Hive, Impala
• Experience in Unix (AIX) shell scripting
• Experience in Financial projects
• Experience in high volume Data migration projects

Please refer to the Position ID when inquiring about a job posting or sending in your resume.