Padmi

Big Data Engineer

IndiaPosted 3 months ago
Software engineeringMid-levelFull Time; Regular
Apply at WISSEN INC

Opens the source posting on shine.com

Source description

About the role

View original

As a Backend Services and Data-driven Applications Designer, you will be responsible for designing and building backend services and data-driven applications. Your role will involve the following key responsibilities: - Develop and maintain Apache Spark-based data processing pipelines. - Integrate REST APIs for backend and data applications. - Write optimized PL/SQL queries for large dataset manipulation. - Automate jobs and manage orchestration using Unix commands and Bash scripts. - Troubleshoot complex technical issues across Java and Spark layers. To excel in this role, you are required to have the following qualifications: - 4+ years of experience in Big Data engineering. - Strong proficiency in Core Java, including Multithreading and Collections Framework. - Practical expertise developing with Apache Spark using Java. - Proficiency in PL/SQL for data querying and transformations. - Experience building and maintaining scalable backend systems. - Strong knowledge of Unix commands and Bash scripting. - Understanding of configuration management and change control processes. - Familiarity with Big Data concepts. Additionally, if you possess the following preferred skills, it would be advantageous: - Experience with Hadoop ecosystem tools like HDFS, Hive, Kafka. - Exposure to cloud platforms such as AWS, Azure, or GCP. - Knowledge of containerization (Docker) and CI/CD pipelines. As a Backend Services and Data-driven Applications Designer, you will be responsible for designing and building backend services and data-driven applications. Your role will involve the following key responsibilities: - Develop and maintain Apache Spark-based data processing pipelines. - Integrate REST APIs for backend and data applications. - Write optimized PL/SQL queries for large dataset manipulation. - Automate jobs and manage orchestration using Unix commands and Bash scripts. - Troubleshoot complex technical issues across Java and Spark layers. To excel in this role, you are required to have the following qualifications: - 4+ years of experience in Big Data engineering. - Strong proficiency in Core Java, including Multithreading and Collections Framework. - Practical expertise developing with Apache Spark using Java. - Proficiency in PL/SQL for data querying and transformations. - Experience building and maintaining scalable backend systems. - Strong knowledge of Unix commands and Bash scripting. - Understanding of configuration management and change control processes. - Familiarity with Big Data concepts. Additionally, if you possess the following preferred skills, it would be advantageous: - Experience with Hadoop ecosystem tools like HDFS, Hive, Kafka. - Exposure to cloud platforms such as AWS, Azure, or GCP. - Knowledge of containerization (Docker) and CI/CD pipelines.

One address, no account. We’ll tell you when matching roles go live.

More at WISSEN INC

Related open roles

View all roles