Senior Software Developer in Test
Vena Solutions
This role will be working out of our Indore office 5 days a week
Position Summary
As a Senior Software Developer in Test, your primary responsibilities are to ensure the quality of our product and code base through the development, execution and maintenance of automation testing, improve test tooling and processes based on industry best practices, and providing excellent product support by triaging and investigating defects and enabling our customer support teams to resolve issues.
You will be pivotal in ensuring the quality and robustness of our Vena Copilot feature and prompt engineering workflows. Your expertise will help validate AI model outputs, enhance system reliability, and align the solutions with business requirements. You will collaborate closely with cross-functional teams to define and implement testing strategies that ensure our AI systems deliver high-quality results.
Our developer-focused team culture encourages our engineers to be self-motivated and self-directed. We value leadership and people with passion who will take ownership to make their mark on our product within our growing business.
What you will do:
- Analyze existing projects and requirements to identify test requirements
- Write, maintain, and manage automated UI tests and API tests
- Contribute to the building and implementing of best fit testing methodologies, including automated test frameworks like Playwright and API test frameworks like Rest-Assured
- Identify and execute test strategies for functional, integration, and regression testing
- Work with development and product management teams to identify testing needs and review testing strategies
- Design comprehensive test cases and scenarios for prompt engineering workflows.
Benchmark prompt engineering result against defined quality metrics such as relevancy, accuracy, coherence, and completeness.
- Perform exploratory testing to uncover edge cases and anomalies.
- Monitor current testing frameworks, ensuring dependability, consistency, scalability and stability
- Collaborate with other developers to build and maintain CI/CD pipelines
Participate in evaluating, selecting, and adopting new technologies
Mentor junior developers and take on large initiatives regarding testing
Does this sound like you?
- 5+ years experience in test development role, preferably within a fast-paced, Agile environment
- Hands on experience with AI/ML testing. Prior experience working with Microsoft OpenAI or similar APIs is a plus
- Post-secondary education in Computer Science or equivalent background and experience
- Demonstrated knowledge of testing methodologies and frameworks and software fundamentals related to development of test cases
- Experienced with development/bug tracking tools (GitHub, JIRA, etc.)
- Proficient with MS Excel and relational databases (SQL, MS SQL, Oracle or DB2)
- Previous experience in one or more programming languages (i.e. .NET, Java, or JavaScript)
- Thorough and detail-oriented approach with an ability to analyze how product changes affect all product components
- Exceptional written and verbal communication skills
Preferred Qualifications
- Experience with VBA and Azure DevOps
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.