Overview
This lecture reviews the current capabilities of Turnitin’s new AI detection tool, demonstrating its effectiveness in identifying AI-generated student writing.
Demonstrating Turnitin’s AI Detection
- Turnitin now includes a tool that detects AI-generated content in student submissions.
- A sample memo comparing three AI writers was generated using ChatGPT for demonstration.
- The memo was formatted in Microsoft Word and uploaded to Turnitin as a student assignment.
- Turnitin returned a traditional similarity score of 45%, mostly citing previously uploaded sources in the document.
- The AI detection feature flagged the memo as 100% AI-written, with a caution notice about possible academic misconduct.
Interpreting Turnitin Reports
- The traditional similarity score (e.g., 45%) reflects matches to existing sources, not necessarily AI content.
- The AI detection score separately identifies the probability that the submission is AI-generated.
- Faculty are advised to review both scores when assessing potential academic integrity issues.
Implications for Faculty and Students
- Turnitin’s AI tool increases the chance of detecting unauthorized AI use in student assignments.
- Faculty may need to update assignment designs and grading rubrics in response to this technology.
- Using AI writers like ChatGPT for assignments may be considered cheating at some institutions, including the University of Texas at Dallas.
- Human-written work is often higher quality and less risky than AI-generated submissions.
Key Terms & Definitions
- Turnitin — An online tool that checks student work for similarity to existing sources and detects AI-generated content.
- Similarity Score — Percentage showing how much of a submission matches published or previously submitted sources.
- AI Detection Score — Percentage estimate indicating how much of a document is likely written by artificial intelligence.
- Academic Misconduct — Unauthorized actions, like using AI writers, considered cheating by university policy.
Action Items / Next Steps
- Review and update assignment prompts and rubrics to address potential AI use.
- Remind students of academic integrity policies regarding AI-generated content.
- Faculty should familiarize themselves with interpreting both similarity and AI detection scores in Turnitin.