Source description
About the role
Job Title: Spark Scala Developer / Technology Lead – Big Data
Location: Irving, TX 75039 (Hybrid/Onsite)
Candidates willing to relocate will be considered.
Duration: 12 Months
Experience Required
Minimum 8 years of IT experience
Minimum 8 years of hands-on experience with Scala and Apache Spark
Required Skills
Apache Spark
Scala
Python
SQL
Nice to Have Skills
Spark Streaming
Hadoop
HDFS
Hive
Sqoop
Impala
NoSQL Databases
UNIX Shell Scripting
Job Responsibilities
Design, develop, and support large-scale distributed data processing applications using Apache Spark and Scala.
Build and optimize data pipelines using Spark Core, Spark SQL, and Spark Streaming.
Develop scalable solutions for processing large volumes of data.
Write clean, efficient, and maintainable Scala code following best practices.
Work with Python, Hadoop, Hive, HDFS, and other Big Data technologies.
Design and develop ETL and data warehousing solutions.
Perform SQL and NoSQL database development and optimization.
Analyze, troubleshoot, and resolve data processing and performance issues.
Collaborate with business users, architects, and cross-functional teams.
Participate in Agile ceremonies including daily standups, sprint planning, reviews, and retrospectives.
Support production environments and ongoing application maintenance.
Stay current with emerging Big Data technologies and industry trends.
Required Qualifications
Strong hands-on experience with Spark Core, Spark SQL, and Spark Streaming.
Strong programming experience in Scala.
Experience with Python and SQL.
Good understanding of Data Structures and Algorithms.
Experience with Hadoop ecosystem technologies.
Knowledge of ETL and Data Warehousing concepts.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent communication and teamwork skills.
Interview Process
Karat Assessment (Mandatory)
Face-to-Face Client Interview
Job type: Contract Division: eTeam Inc (US) Category: eTeam United States Reference: 26-54250
More at eTeam