Singapore Unveils Insights from world’s first technical testing of real world applications of GenAI

May 30, 2025 | Friday | News

World’s first Starter Kit for Gen AI applications to provide practical guidance to healthcare industry

Singapore unveiled key insights from its Global AI Assurance  Pilot, an initiative to catalyse emerging norms and best practices around technical testing of  Generative AI (GenAI) applications. These insights then provided the blueprint for the world’s  first Testing Starter Kit for GenAI applications, which is now open for views.

A new AI for Good partnership between AI Singapore and United Nartions UNDP, extending our capacity building efforts beyond Singapore to Southeast Asia, the Caribbean, and Pacific Islands.


These global  initiatives were announced by Mr Tan Kiat How, Senior Minister of State for Digital  Development and Information at the ATxSummit 2025, the flagship event of Asia Tech x  Singapore (ATxSG). These efforts put Singapore at the forefront of efforts to operationalise AI  safety, accelerate trusted and responsible AI adoption and deployment, and promote  international cooperation for AI that benefits all.

Global AI Assurance Pilot 

To encourage safe adoption of AI in industries, the Global AI Assurance  Pilot was launched in February 2025, an initiative by the AI Verify Foundation (AIVF) and  Infocomm Media Development Authority (IMDA) to catalyse emerging norms and best  practices around technical testing of Gen AI applications. The pilot received strong interest  from both local and international AI stakeholders, especially from companies deploying Gen  AI in their business process. In the pilot, 16 specialist AI testers were paired with 17 deployers  of real-world Gen AI applications – from 10 different industries including finance, healthcare,  HR, people and public sectors.

IMDA also announced plans to develop a first of its kind Testing Starter Kit for  Gen AI applications. The Starter Kit generalises key insights from the Assurance Pilot and  consultations with other practitioners to provide practical testing guidance for all businesses  developing or leveraging GenAI applications, across sectors and use-cases.

The Starter Kit  provides a step-by-step guide on how to think about risks to be concerned about,  highlighting common ones like hallucination, undesirable content, data disclosure, and  vulnerability to adversarial prompts, and subsequently how to test the Gen AI applications.  IMDA is calling for views from the industry on this Starter Kit on the testing guidance as well  as recommended tests for the four identified risks.

Over 30 companies around the world, across 10 sectors (including high trust high risk areas from HR, to Healthcare to Finance) conducted practical tests. An demonstration with Changi General Hospital using AI to support colonoscopy analysis was the higlight of the event. This assurance pilot is a key engine, that will continue to allow us to advance practical approaches, learn and collectively move trusted AI forward.

 

Sign up for the editor pick and get articles like this delivered right to your inbox.

+Country Code-Phone Number(xxx-xxxxxxx)

Comments

× Your session has been expired. Please click here to Sign-in or Sign-up
   New User? Create Account