Guides: WRIT 1150 Library Toolkit: Evaluating AI Generated Content

Evaluating AI-Generated Content

Evaluating AI-Generated Content
1. Break it Down	Break down the information. Identify specific claims.
2. Search	Look for information supporting a specific claim. To verify specific information claims, use Google or Wikipedia. To confirm a source exists, use Google Scholar, WorldCat, or HoyaSearch.
3. Analyze	Consider the information discovered in light of assumptions: What did your prompt assume? What did the AI presume? What perspective or agenda do your fact-check findings hold?
4. Decide	What is true? What is misleading? What is factually incorrect? Can you update your prompt to address any errors?
5. Repeat / Conclude	Repeat this process for each of the claims identified in the Break It Down stage. Make judgment calls on the validity of the claims and decide if they are relevant or useful for your research.
Source: University of Maryland College Park. AI and Information Literacy. License: CC BY-NC 4.0.

Evaluating AI-Generated Sources
1. Identify	What source(s) has the AI tool pointed you you? This may be a full or a partial citation.
2. Search	Use external tools to verify the existence of the source. Google Scholar, WorldCat, or HoyaSearch are good tools for verifying sources.
3. Decide	Does the source exist? If not, were any aspects of the citation correct?
4. Find or Move On	If the source is real, does Georgetown have access to it? Check HoyaSearch to verify. If the source is a hallucination, did your investigation reveal a more reliable source for the topic?