Faiz Rahman, S.H., LL.M., a member of the Center for Law, Technology, RegTech, and LegalTech Studies (CTRL) UGM research team, stated that the phenomenon of AI hallucinations requires attention from GenAI users. This is because GenAI has the potential to generate answers that appear convincing and real, but are actually fabricated.
"It is important for GenAI users, especially academics and legal practitioners, to understand how to better conduct legal prompting so that GenAI's answers can be more accurate. This is because how GenAI answers questions also depends heavily on how the user formulates and asks the questions (prompting)," said Faiz at the Research Results Dissemination and Limited Seminar at the UGM Faculty of Law on Friday (November 1, 2024).
At the event, titled "Implementation of Generative Artificial Intelligence for Legal Research," held by CTRL UGM in collaboration with Hukumonline, Faiz presented the results of an evaluative study on Hukumonline's GenAI ASK to test the accuracy and reliability of its answers.
Based on the research conducted by CTRL UGM, Hukumonline's ASK AI correctly answered 165 of the 200 legal questions posed. This result is higher than ChatGPT 4o, which answered 116 questions, and ChatGPT 3.5, which only answered 46 questions correctly.
"200 questions were answered in less than 30 minutes, with a fairly high level of accuracy. This demonstrates the significant potential of GenAI in transforming the way people conduct legal research," said Faiz Rahman.
Writer: Bagus Nur Alfandy dan Alif Duta Hardenta (CTRL UGM)
Editor: Public Relations
