Big Data Engineer
- Full time
- India (Remote) IN
- @Affine
Job Detail
-
Job ID 3098
-
Career Level Others
-
Experience 4-6 Years
-
Industry IT & BPM
-
Qualifications Degree Bachelor
Job Description
Roles & Responsibilities:
- Sound knowledge in Spark architecture and distributed computing.
- Proficient in Spark – including RDD and Dataframes core functions, troubleshooting and performance tuning.
- Good understanding in object-oriented concepts and hands on experience on Scala with excellent programming logic and technique.
- Good in functional programming and OOPS concept either on Scala
- Good experience in SQL – should be able to write complex queries.
- Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
- Able to mentor new members for onboarding to the project.
- Understand the client requirement and able to design, develop from scratch and deliver.
- AWS cloud experience would be preferable.
- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services – DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (prefered)
- Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (prefered)
Job Requirement:
- Scala
- Spark
- SQL (Intermediate to advanced level)
- AWS preferable/Any cloud
Good to Have Skills:
- AWS Certification
- Basic knowledge of streaming
- Object-Oriented Programming
- Good knowledge on ETL/ELT processes and tools
- Knowledge on hive, Hadoop, Kafka, Streaming
- Git/similar version control tool
- Knowledge in CI/CD, Microservices
