Five master’s students at Cornell Tech in New York City have put on alter egos with bad intent as part of an effort to improve artificial intelligence safeguards for health workers serving people with diabetes. The students—Divya Bhanushali, Bhavya Gopal, Ali Hasan, Nikhil Jain, and Om Kamath—are part of the inaugural cohort of the Security, Trust, and Safety Initiative (SETS) AI Content Red Team Clinic. The clinic, which debuted this fall on the Roosevelt Island campus, offers free red-teaming services to public-service organizations that may not have the capacity to stress-test their AI systems.

Red-teaming is the practice of simulating external attacks on digital tools in order to expose vulnerabilities. Alexios Mantzarlis, the director of the SETS Initiative, explained that this approach, originally used in cybersecurity, helps identify weaknesses in AI tools before they can be exploited in real life. Nikhil Jain, a master’s student in information systems, noted that the experience involved adopting the mindset of adversarial users to stress-test AI systems, uncover unexpected outcomes, and assist clients in enhancing their safeguards.

The red team’s work is intended to help public-service organizations build stronger guardrails around AI tools, ensuring that these systems are more secure and reliable when used in real-world applications. More information is available at Cornell University’s official news site.

Source: Cornell University

Source Type: College

Source Location: Ithaca

Ithaca, NY

https://www.facebook.com/709174307912162/posts/1254254326737488

Ithaca Closes City Facilities amid Winter Emergency

City facilities close Monday amid snow emergency; essential services continue.

Cornell Men's Hockey Beats Harvard at Home

Cornell hockey beats Harvard in a lively home game at Lynah Rink.

Ithaca Prepares for Snowstorm Amid Freezing Temps

Ithaca braces for winter storm, enforcing odd-even parking and road safety measures.

Cornell Welcomes All Students for Term Start

Cornell's successful start sees all Cornellians return to campus in Ithaca.

Ithaca Enforces Odd-Even Winter Parking Regulation

Ithaca enacts odd-even parking rules to aid winter snow removal.

Cornellians Hit Ground Running on First Day

Cornellians in Ithaca quickly start embracing campus life.

Ithaca Revises Tax Payment Mailing and Postmark

Ithaca taxpayers: update mailing address; observe new USPS postmark rule timing.

Cornell Kicks Off New Spring Term

Cornell launches spring semester with community support and positive start tips.

Cornell Celebrates Teamwork and Community Efforts

Cornell values teamwork and recognizes supportive contributions.

Cornell Botanic Gardens Celebrates 100 Years of Stewardship

Cornell Botanic Gardens: a century of stewardship and educational natural preservation.