Machine Learning Engineer
Fullscript
What you'll do:
- Development and deployment of production, multi-turn LLM-powered features, including summarization tools and clinician-facing conversational agents that handle follow-up questions and reasoning over clinical context
- Build and own backend services in Python that integrate LLM agents with Fullscript’s platform
- Implement prompting, grounding, and safety strategies to optimize model outputs in clinical workflows
- Implement AI feature quality testing, evaluation of LLM outputs (accuracy, hallucinations, edge cases), CI/CD pipelines, and version control for all model-related workflows
- Collaborate with medical and product teams to deliver AI features that reflect real clinical reasoning and practitioner workflows
- Work cross-functionally with engineering, analytics, and medical SMEs to refine requirements and ensure data solutions support clinical contexts
- Stay current with the latest LLM research and emerging AI technologies
What you bring to the table:
- 3+ years of experience building and implementing LLM applications used in production, including conversational or agent-based systems
- Experience with LLM application frameworks (LangChain, LangGraph, Hugging Face tools), including agent orchestration, tool use, or RAG pipelines
- Familiarity with model evaluation and monitoring frameworks for LLM outputs and conversational quality
- Knowledge of MCP and agent orchestration tools
- Strong proficiency in Python and SQL
- Deep understanding of data engineering best practices, including version control, testing, and CI/CD methodologiesgineering best practices, including version control, testing, and CI/CD m
- Experience designing AI systems that answer open-ended questions, support follow-up interactions, and explain their reasoning
- Ability to communicate complex technical concepts effectively to technical and non-technical stakeholders
- Learning mindset, with a keen interest in exploring new technologies and methodologies
Bonus if you have:
- Familiarity with model evaluation and monitoring frameworks
- Snowflake Snowpark or PySpark experience
- Knowledge of MCP, Langfuse, or agent orchestration tools
- Graph database experience (Neo4j)
- Exposure to healthcare, clinical data, or decision-support systems
What we can offer you:
- SalaryFlexible PTO & competitive pay—rest fuels performance.
- RRSP match & stock options—invest in your future.
- Customizable benefits—flexible coverage, paramedical services, and an HSA.
- Fullscript discounts—save on wellness products.
- Continuous learning—training budget + company-wide initiatives.
- Wherever You Work Well—hybrid and remote flexibility.
