View All Jobs 2199
Staff AI Platform Engineer
Develop and deploy LLM-based systems for production workflows focusing on efficiency and scalability.
Expert
3 weeks ago
Snorkel AI
The data-centric AI platform powered by programmatic labeling and foundation models
27 Similar Jobs at Snorkel AI
✨ About The Role
- The Staff AI Platform Engineer will be responsible for designing and implementing core AI pipelines that drive SnorkelFlow's AI capabilities.
- This role involves providing technical leadership and direction for the development of scalable and robust AI pipelines.
- The engineer will lead the development and optimization of MLFlow pipelines for deployment and maintain AI pipelines for labeling, embeddings, training, and deploying models.
- The position requires collaboration with various teams, including Compute Platform and Data Platform, to ensure seamless integration and interoperability.
- Establishing observability standards for AI pipelines and defining key metrics for system health and optimization will also be part of the responsibilities.
âš¡ Requirements
- The ideal candidate will have a strong background in AI development, particularly with large language models (LLMs) and traditional NLP solutions.
- A minimum of 8 years of experience in AI development, with a proven track record of leading technical projects and mentoring engineers is essential.
- Proficiency in Python and deep learning frameworks such as PyTorch is required for success in this role.
- Strong communication skills are necessary to effectively collaborate with cross-functional teams and translate product goals into technical roadmaps.
- The candidate should have a deep understanding of LLM architectures, fine-tuning, and deployment methodologies.
About Snorkel AI
The data-centric AI platform powered by programmatic labeling and foundation models