Senior Software Engineer, LLM

The Opportunity

Our growing company is actively seeking a highly-skilled Large Language Model (LLM) Engineer to join our team. This role will have you directly involved in the design and development of state-of-the-art LLM-based algorithms and systems that power our conversational AI applications. If you possess a passion for pushing the boundaries of LLM technologies and have relevant LLM experience, we would love to connect.

Your Impact

• Spearhead the design, development and optimization of robust, scalable systems and infrastructure for deploying pioneering algorithms and systems based on large language models.
• Conduct research and rapidly prototype neural network architectures, training pipelines, inference servers, etc., ensuring we continually stay a step ahead in serving production workloads.
• Benchmark and profile diverse software/hardware configurations, striving for optimal model performance. 
• Drive implementation of model optimizations for a more scalable and cost effective LLM system.
• Collaborate closely with our team of research engineers to streamline the transition of machine learning models and algorithms into production.
• Monitor and incessantly enhance system efficiency, latency, throughput and more.

We're looking for someone who

• A Masters Degree in Computer Science or a related technical discipline, PhD is a plus.
• 5+ years of demonstrated experience in the construction and optimization of AI/NLP infrastructure and pipelines.
• Proficiency in Python and experience with frameworks like PyTorch/TensorFlow.
• Experience working with existing large language models is highly desirable.
• Superior system design and analytical abilities, with an eye for problem-solving.
• Demonstrated capacity to deliver in a high-velocity, dynamic environment.