Description
We are seeking a highly skilled Data Engineer with specialised experience in Data Science, Machine Learning, Deep Learning, and advanced Statistical Algorithms. The successful candidate will be instrumental in developing, optimizing, and deploying complex data systems that leverage state-of-the-art machine learning frameworks for text and image generation/classification. You will collaborate closely with cross-functional teams to ensure seamless integration and functionality of data-driven applications.
Key Responsibilities
1. Data Pipeline Development:
Design, develop, and maintain scalable data pipelines that facilitate the extraction, transformation, and loading (ETL) of large and diverse datasets.
Optimize data flows and collection processes.
2. Machine Learning & Deep Learning:
Develop and deploy machine learning models using Python.
Implement models using LLMs, Transformers, and transformer-based architectures for various NLP tasks.
Build and enhance algorithms for text generation and classification.
3. Collaboration & Integration:
WOrk closely with stakeholders to understand requirements and deliver solutions.
Ensure seamless integration of data models and systems with other application components.
4. Performance Tuning & Debugging:
Perform system tuning, troubleshooting, and optimisation to enhance performance.
Conduct root cause analysis of system performance and implement corrective actions.
Qualifications:
Bachelors or Masters degree in Computer Science, Data Science, Engineering, Statistics, or related field.
Hands-on experience in deep learning techniques, specifically with LLMs, Transformers, BERT.
Hands-on experience with Python and relevant data science libraries (e.g., TensorFlow, PyTorch, Keras, Scikit-learn).
Technical Skills:
Proficiency in Python and No-SQL databases.
Strong understanding of data structures, data modeling, and software architecture.
Experience with version control systems (e.g., Git).
Familiarity with big data technologies (e.g., Spark, Hadoop) is a plus.
Other Skills:
Excellent problem-solving and analytical skills.
Strong written and verbal communication skills.
Ability to work collaboratively in a fast-paced, team-oriented environment.