Backend Engineer Data Platform

You are a talented and motivated Software Developer with expertise in object-oriented programming languages, a strong aptitude for solving Bigdata problems, and a passion for designing sophisticated Bigdata solutions. As a key member of the development team in the data security domain, you will contribute to creating innovative software solutions. Responsibilities: - Develop high-quality software solutions using Python/Java programming language. - Create high-performance data pipelines for real-time and batch processing on Lakehouse. - Collaborate with cross-functional teams to understand project requirements and translate them into technical specifications. - Design and implement complex, scalable, and reliable systems meeting business requirements. - Troubleshoot, debug, and optimize pipelines on Lakehouse to ensure performance and reliability. - Stay updated with the latest industry trends, tools, and technologies. - Work closely with DevOps to deploy and maintain applications using Docker and Kubernetes. - Utilize AWS and other cloud platforms to build, deploy, and scale applications. - Integrate various cloud services to enhance system functionality. Requirements: - Energetic self-starter with a desire to work in a startup environment. - Experience in Bigdata processing using Spark, Spark Streaming, Flink, Kafka, S3, and Lakehouse (Hudi/Iceberg/DataLake). - Proficiency in advanced Java/Python programming skills. - Previous work on cloud-based applications built on microservices-based paradigms achieving horizontal scaling. - Strong understanding and hands-on experience with Elasticsearch, SQL, NoSQL DB (e.g., mongoDB), and Kubernetes. - Hands-on experience in Complex Event Processing systems. - Ability to solve scale and performance issues related to cloud applications. - Experience debugging applications running on Unix-like systems (e.g., Ubuntu, CentOS). - Development of RESTful APIs for complex data sets. - Knowledge of container-based development & deployment (e.g., Dockers, rkt) with exposure to AWS, Google Cloud Platform, Microsoft Azure. - Expertise in the software security domain is a plus. Concentric AI never asks for money or paid certifications during the interview process. Such behavior is a known scam, of which we are aware. You are a talented and motivated Software Developer with expertise in object-oriented programming languages, a strong aptitude for solving Bigdata problems, and a passion for designing sophisticated Bigdata solutions. As a key member of the development team in the data security domain, you will contribute to creating innovative software solutions. Responsibilities: - Develop high-quality software solutions using Python/Java programming language. - Create high-performance data pipelines for real-time and batch processing on Lakehouse. - Collaborate with cross-functional teams to understand project requirements and translate them into technical specifications. - Design and implement complex, scalable, and reliable systems meeting business requirements. - Troubleshoot, debug, and optimize pipelines on Lakehouse to ensure performance and reliability. - Stay updated with the latest industry trends, tools, and technologies. - Work closely with DevOps to deploy and maintain applications using Docker and Kubernetes. - Utilize AWS and other cloud platforms to build, deploy, and scale applications. - Integrate various cloud services to enhance system functionality. Requirements: - Energetic self-starter with a desire to work in a startup environment. - Experience in Bigdata processing using Spark, Spark Streaming, Flink, Kafka, S3, and Lakehouse (Hudi/Iceberg/DataLake). - Proficiency in advanced Java/Python programming skills. - Previous work on cloud-based applications built on microservices-based paradigms achieving horizontal scaling. - Strong understanding and hands-on experience with Elasticsearch, SQL, NoSQL DB (e.g., mongoDB), and Kubernetes. - Hands-on experience in Complex Event Processing systems. - Ability to solve scale and performance issues related to cloud applications. - Experience debugging applications running on Unix-like systems (e.g., Ubuntu, CentOS). - Development of RESTful APIs for complex data sets. - Knowledge of container-based development & deployment (e.g., Dockers, rkt) with exposure to AWS, Google Cloud Platform, Microsoft Azure. - Expertise in the software security domain is a plus. Concentric AI never asks for money or paid certifications during the interview process. Such behavior is a known scam, of which we are aware.