View All Jobs 1009

Software Engineer (Ray Data)

Lead future work integrating streaming workloads into Ray such as Beam on Ray
San Francisco, California, United States
Mid-Level
$170,112 - 237,000 USD / year
2 months ago
Anyscale

Anyscale

Ray is the most popular open source framework for scaling and productionizing AI workloads.

✨ About The Role

- The role involves working on Ray's Data team to build, optimize, and scale Ray's Datasets library and data processing capabilities - Responsibilities include improving the performance of RayDatasets at large scale, integrating with ML training and data sources, and leading future work on streaming workloads integration - The position requires identifying, implementing, and evaluating architectural improvements to Ray core and Datasets, as well as enhancing the testing process for smooth releases - Collaboration with other Ray teams like Train, RLlib, and Serve is essential to ensure the success of the projects - The ideal candidate will play a crucial role in advancing Ray's mission to democratize distributed computing and make it accessible to developers of all skill levels

⚡ Requirements

- Experienced software engineer with at least 3-4 years of relevant work experience in building scalable and fault-tolerant distributed systems - Strong background in algorithms, data structures, and system design, with a focus on data processing and database internals - Proficient in working with Spark or Dask, and experience with streaming workloads is a plus - Skilled in developing high-quality open-source software to simplify distributed programming - Excellent communication skills to effectively share work through talks, tutorials, and blog posts
+ Show Original Job Post
























Software Engineer (Ray Data)
San Francisco, California, United States
$170,112 - 237,000 USD / year
Software
About Anyscale
Ray is the most popular open source framework for scaling and productionizing AI workloads.