Quality Engineer - for Artificial Intelligence Insights Platform

Join the AI Revolution with Gemmo.ai!

At Gemmo.ai, we're at the forefront of artificial intelligence innovation, delivering state-of-the-art solutions for international clients across industries. Headquartered in Ireland, Gemmo R&D team is based in Milano, Italy where we provide a unique opportunity for software developers passionate about learning and applying AI to cutting-edge projects. As part of our team, you’ll collaborate with global industry leaders, work on exciting challenges, and develop advanced skills in AI and machine learning. We pride ourselves on fostering a culture of growth, creativity, and collaboration, making Gemmo.ai the perfect place for ambitious developers to take their careers to the next level. Be part of the future of AI—right here, right now, with Gemmo.ai!

We building a cutting-edge Insights Subsystem designed to revolutionize the way financial advisors, wealth managers, and other stakeholders interact with data. Our subsystem:

• Ingests and enriches data with third-party sources for advanced analytics in Snowflake.
• Provides insights using relationships between advisors, clients, and accounts.
• Delivers prioritized, context-specific insights.
• Features a chat-based “co-pilot” backed by a Large Language Model (LLM) to enable self-service, data visualization, and interaction.
• Incorporates robust compliance and operational features like audit logs and user activity summaries.

To ensure the success of this subsystem, we are seeking a motivated Automation Tester to lead our quality assurance efforts and help deliver a best-in-class solution.

As an Automation Tester, you will:

• Test Framework Development:
• Design, build, and manage comprehensive test frameworks to validate primary use cases and edge scenarios.
• Utilize diverse testing methods, including property-based testing (Hypothesis), unit testing, and other advanced approaches.
• Automation and Coverage:
• Formulate and execute an appropriate mix of data tests, API tests, and UI-free testing to ensure thorough coverage.
• Develop strategies for validating non-deterministic outputs, such as insights and LLM responses.
• UI and API Free-Testing:
• Conduct exploratory testing to identify issues from the perspective of end-users like Financial Advisors and Wealth Managers.
• Use creativity and analytical thinking to spot issues missed by conventional testing.
• LLM Testing and Compliance:
• Stay updated on the latest developments in LLM testing, including methods like “jailbreak” testing for safety and compliance.
• Define and validate the scope of acceptable request/response data to prevent non-compliant or reputationally damaging outputs.
• Collaboration and Reporting:
• Collaborate with development teams to ensure alignment with agile processes.
• Provide clear, consumable test reports to stakeholders, flagging regression issues promptly.
• Act as the voice of the customer, offering insights and influencing product and engineering decisions.

Qualifications: To succeed in this role, you should have:

• Technical Expertise:
• Proficiency in Python, REST clients, and database persistence.
• Strong SQL skills and familiarity with data warehouse design.
• Experience with various automated testing methodologies.
• Analytical and Creative Skills:
• A highly numerate mindset with a knack for problem-solving.
• Creativity in leveraging Python and test frameworks for efficient, high-coverage testing.
• Communication and Collaboration:
• Excellent communication skills and the ability to convey technical insights effectively.
• A collaborative approach with the ability to influence peers and stakeholders.
• Curiosity and Drive:
• A curious mindset, eager to learn and ask questions.
• A proactive attitude to identify and address potential issues.

• The opportunity to work on a high-impact product that directly benefits financial advisors and wealth managers.
• A collaborative and dynamic team environment.
• Competitive salary and benefits package.