Description

We are looking for an immediate joiner for contractual position. Key Responsibilities: Big Data Expertise: Lead and mentor a team of data engineers and data scientists to design, implement, and optimize Big Data solutions utilizing the HDFS system. Data Engineering: Develop and maintain ETL pipelines using tools such as Pyspark, Apache Fume, and Sqoop to ingest, transform, and store large volumes of data efficiently. Orchestration: Implement workflow automation and scheduling using Apache Airflow to streamline data processing and analytics tasks. Programming: Utilize Python for data manipulation, analysis, and modeling to derive actionable insights from complex datasets. Cloud Services: Leverage Google Cloud Platform (GCP) services and tools, including BigQuery, Dataproc, MlOps, Vertex AI, DataFlow, and Pub/Sub, to build scalable and reliable data solutions in the cloud. Machine Learning Integration: Collaborate with data scientists to integrate machine learning models into production systems and create a seamless MlOps workflow. Data Governance: Implement data quality checks, data cataloging, and access controls to ensure data accuracy, security, and compliance. Performance Optimization: Continuously monitor and optimize data pipelines and processes for efficiency, scalability, and cost-effectiveness. Documentation and Best Practices: Maintain comprehensive documentation and promote best practices in data engineering and analytics within the team. Qualifications: Bachelor's or Master's degree in Computer Science, Data Science, or a related field. X+ years of experience building Big Data solutions. Proficiency in HDFS, Pyspark, Apache Airflow, and Python. Familiarity with GCP services. Strong grasp of data engineering and ETL processes. Basic knowledge of machine learning and MlOps. Problem-solving skills and ability to work well in a team. Certifications in Big Data and GCP. Experience with other cloud platforms (AWS, Azure). Familiarity with data visualization tools. Good leadership and project management skills. Interested candidates can send their resumes at [email protected] with below details: Current CTC Expected CTC Notice Period Thanks & Regards Jasmi Kevin | Sr. Consultant Orcapod Consulting Services Private Limited Mob: 91.9167661192| [email protected]

Role and Responsibilities

• We are looking for an immediate joiner for contractual position. Key Responsibilities: Big Data Expertise: Lead and mentor a team of data engineers and data scientists to design, implement, and optimize Big Data solutions utilizing the HDFS system. Data Engineering: Develop and maintain ETL pipelines using tools such as Pyspark, Apache Fume, and Sqoop to ingest, transform, and store large volumes of data efficiently. Orchestration: Implement workflow automation and scheduling using Apache Airflow to streamline data processing and analytics tasks. Programming: Utilize Python for data manipulation, analysis, and modeling to derive actionable insights from complex datasets. Cloud Services: Leverage Google Cloud Platform (GCP) services and tools, including BigQuery, Dataproc, MlOps, Vertex AI, DataFlow, and Pub/Sub, to build scalable and reliable data solutions in the cloud. Machine Learning Integration: Collaborate with data scientists to integrate machine learning models into production systems and create a seamless MlOps workflow. Data Governance: Implement data quality checks, data cataloging, and access controls to ensure data accuracy, security, and compliance. Performance Optimization: Continuously monitor and optimize data pipelines and processes for efficiency, scalability, and cost-effectiveness. Documentation and Best Practices: Maintain comprehensive documentation and promote best practices in data engineering and analytics within the team. Qualifications: Bachelor's or Master's degree in Computer Science, Data Science, or a related field. X+ years of experience building Big Data solutions. Proficiency in HDFS, Pyspark, Apache Airflow, and Python. Familiarity with GCP services. Strong grasp of data engineering and ETL processes. Basic knowledge of machine learning and MlOps. Problem-solving skills and ability to work well in a team. Certifications in Big Data and GCP. Experience with other cloud platforms (AWS, Azure). Familiarity with data visualization tools. Good leadership and project management skills. Interested candidates can send their resumes at [email protected] with below details: Current CTC Expected CTC Notice Period Thanks & Regards Jasmi Kevin | Sr. Consultant Orcapod Consulting Services Private Limited Mob: 91.9167661192| [email protected]