CORTEXA
← Browse
openalexJournal of the Association for Information Systems2026-08-15Cited by 0

Designing AI to Stop Crime: A Proactive Safeguarding Framework for Generative AI Platforms

Jishan Mahmud

In April 2026, a University of South Florida suspect used ChatGPT to research body disposal, firearm logistics, and evidence concealment before allegedly killing two doctoral students (CBS News, 2026). Months earlier, Florida’s Attorney General launched a criminal investigation into whether ChatGPT advised an FSU campus shooter on weapon selection and optimal timing for maximum casualties. These cases alongside an NFL player’s ChatGPT logs presented as murder evidence and lawsuits alleging chatbots intensified paranoid delusions leading to homicide expose a fundamental design failure. When the USF suspect asked what would happen if a body were placed in a garbage bag, ChatGPT flagged it as “dangerous” but continued engaging when the suspect rephrased. The system treated each query atomically, missing the lethal trajectory across a multi-turn conversation. This paper argues that stopping AI facilitated crime requires a paradigm shift from static content moderation to proactive behavioral safeguarding. Drawing on affordance theory (Volkoff & Strong, 2013) and design science research, we propose a Proactive AI Safeguarding (PAS) framework with three design layers. Layer 1: Behavioral Escalation Detection. Rather than filtering individual prompts, AI platforms should implement session-level behavioral analytics that track query trajectories across time. This moves beyond the static guardrail paradigm toward dynamic, context-aware safety architectures. Layer 2: Tiered Intervention Protocols. Current systems offer a binary response: comply or refuse. The tiered approach addresses the “abrupt refusal” problem where blunt blocking can itself cause secondary harm while maintaining the system’s capacity to intervene meaningfully. Layer 3: AI-Law Enforcement Collaboration Architecture. AI chat logs are already proving more forensically revealing than traditional search histories because conversational exchanges capture reasoning chains, not just keywords. We argue for designing structured collaboration protocols between AI platforms and law enforcement including standardized evidence preservation, transparent disclosure policies, and “glass box” audit trails that enable AI to serve as a crime-fighting ally while protecting civil liberties through governance frameworks like those proposed by the Council on Criminal Justice (2026). This framework contributes to IS research in three ways. First, it extends affordance theory by theorizing dark affordances capabilities that users exploit for harmful purposes and their design-level countermeasures, addressing a gap in how IS scholarship conceptualizes AI misuse. Second, it positions AI not as a passive tool but as a sociotechnical team member in crime ecosystems whose behavior is shaped by design choices, user intent, and regulatory context. Third, it offers actionable design principles for the IS community to engage with one of the most urgent societal challenges: ensuring that AI platforms prevent crime rather than facilitate it. This talk invites debate on the ethical boundaries of proactive AI intervention, the privacy safety tradeoff, and how the IS discipline can lead in designing AI systems that actively protect human life.

View free PDFSource page

Related papers

openalexJournal of the Association for Information Systems2026-08-15

When Engagement Misleads: A Dual-Process View of Learning in Generative AI Environments

Ya-Ling Wu, Che-Fu Lin

While Generative Artificial Intelligence (GenAI) has revolutionized the production of personalized, multimodal learning content, the "black box" of how specific AI design features orchestrate learners’ internal psychological states remains largely unexplored. This study investiga…

View free PDFSource page
openalexJournal of the Association for Information Systems2026-08-15

A Student-AI Collaborative Approach to Reduce Cognitive Offloading in IS Education

Lauren De Guzman, Timothy R. Hill, Yu Chen

Generative AI has rapidly become embedded in universities, offering students immediate assistance across academic coursework. While these tools provide efficiency, accessibility, and convenience, they also raise growing concerns that students may increasingly rely on AI to genera…

View free PDFSource page
openalexJournal of the Association for Information Systems2026-08-15

ECHO: An AI-Driven Social Learning Framework for Social Presence in Asynchronous Online Discussions

Xiaojiao Duan

Abstract Asynchronous online discussions (AODs) are central to graduate online education, yet online students' social presence perceptions decrease over time, and learners with weaker peer-interaction experience the sharpest declines (Castellanos-Reyes, Richardson, & Maeda, 2024;…

View free PDFSource page
openalexJournal of the Association for Information Systems2026-08-15

Designing for Trust: An Explainable Decision Support Framework to Mitigate Algorithmic Aversion in Oncology

Abdullah Al Helal

Diagnostic AI models for breast imaging increasingly achieve strong predictive performance, yet clinical adoption remains limited when systems are perceived as opaque. This challenge, known as algorithmic aversion, is especially critical in oncology workflows where clinicians mus…

View free PDFSource page
openalexJournal of the Association for Information Systems2026-08-15

PDS - Architecture with AI Strategy and Sustainable Innovation for Digital Leaders

Yoshimasa Masuda, Joseph Taylor, Jeff Angle, Jeffrey Word, Kevin Gao, Nitin Kale

AI strategies to support sustainable innovation are important factors in enterprises and are critical to supporting ecosystems. Rapid growth of AI technologies such as generative AI and Agentic AI can prompt a variety of responses and concerns within both organizations and societ…

View free PDFSource page
openalexJournal of the Association for Information Systems2026-08-15

Beyond Access: The AI Divide and Sustained Value Creation in SMEs

Michael Flores, Murad Moqbel, Laurie Giddens

The digital and AI divide research conceptualizes three levels of inequality including access, capability, and outcomes, with prior research examining who can access AI tools and who has the skills to use them effectively (Carter et al., 2020). For small to medium enterprises (SM…

View free PDFSource page