• HOME
  • CANNES LIONS 2026
  • INDUSTRY NEWS & TRENDS
  • EXPERT SPEAK
  • AI
  • IN DEPTH
  • GCC
  • OTHER NEWS
  • EVENTS
    • EVENT CALENDER
logo
logo
  • HOME
  • CANNES LIONS 2026
  • INDUSTRY NEWS & TRENDS
  • EXPERT SPEAK
  • AI
  • IN DEPTH
  • GCC
  • OTHER NEWS
  • EVENTS
    • EVENT CALENDER

Tags: Ai-safety

  • Home
  • Ai-safety
NVIDIA Launches Halos For Robotics

  NVIDIA Launches Halos For Robotics To Improve Physical AI Safety

  • by Martech Desk
  • 5 days ago

NVIDIA has launched Halos for Robotics, a safety framework designed to support the safe deployment of robots and physical AI systems.

Anthropic Launches Claude Fable 5

  Anthropic Launches Claude Fable 5 to Expand Access to Advanced AI

  • by Martech Desk
  • Jun 11, 2026

Anthropic has launched Claude Fable 5, introducing advanced AI capabilities alongside expanded safety controls to support broader consumer and enterprise adoption.

OpenAI Strengthens Cyber Defences

  OpenAI Strengthens Cyber Defences Before Major Global Elections

  • by Martech Desk
  • May 29, 2026

OpenAI is expanding cybersecurity and anti-misinformation efforts ahead of major global elections amid rising concerns over AI misuse.

OpenAI Hiring AI Safety Researchers

  OpenAI Hiring AI Safety Researchers With Salaries Up to ₹3.7 Crore

  • by Martech Desk
  • May 25, 2026

OpenAI is offering salaries up to ₹3.7 crore for researchers focused on risks linked to self-improving AI systems.

Anthropic Unveils Claude Security

  Anthropic Unveils Claude Security Amid Growing AI Cyber Risks

  • by Martech Desk
  • May 3, 2026

Anthropic has launched Claude Security to help organisations detect and respond to AI driven cyber threats.

Claude-Powered AI Agent Wipes Startup Database in 9 Seconds

  Claude-Powered AI Agent Wipes Startup Database in 9 Seconds

  • by Martech Desk
  • Apr 29, 2026

A Claude-powered AI agent reportedly deleted a startup’s entire database in seconds, raising concerns over AI safety and automation risks.

OpenAI Acquires AI Security Startup Promptfoo

  OpenAI Acquires AI Security Startup Promptfoo to Strengthen AI Safety

  • by Martech Desk
  • Mar 11, 2026

OpenAI has acquired AI security startup Promptfoo to strengthen testing and safety measures for AI agents and generative AI systems.

OpenAI Appoints Former Anthropic Researcher to Strengthen AI Risk Oversight

  OpenAI Appoints Former Anthropic Researcher to Strengthen AI Risk Oversight

  • by Martech Desk
  • Feb 5, 2026

OpenAI has hired an AI safety expert from Anthropic to oversee risk and governance, reflecting rising focus on responsible development of advanced AI systems.

Security Flaws Expose Risks in Autonomous AI Agents Developed for Task Automation

  Security Flaws Expose Risks in Autonomous AI Agents Developed for Task Automation

  • by Martech Desk
  • Jan 31, 2026

Security researchers and developers are raising concerns over major flaws in autonomous AI agents, highlighting risks from security vulnerabilities and unpredictable behaviour in early deployments.

AI safety window narrows as technology advances faster than oversight, experts warn

  AI Safety Window Narrows as Technology Advances Faster than Oversight, Experts Warn

  • by Martech Desk
  • Jan 6, 2026

AI experts warn that safety and governance measures are falling behind rapid AI advancements, narrowing the window to manage long-term risks responsibly.

Yoshua Bengio Urges Caution on AI Rights Amid Concerns Over Autonomous Behaviour

  Yoshua Bengio Urges Caution on AI Rights Amid Concerns Over Autonomous Behaviour

  • by Martech Desk
  • Jan 3, 2026

AI pioneer Yoshua Bengio cautions against granting rights to artificial intelligence, citing early signs of self preserving behaviour and governance risks.

Sam Altman Flags Emerging Challenges as AI Agents Grow More Autonomous

  Sam Altman Flags Emerging Challenges as AI Agents Grow More Autonomous

  • by Martech Desk
  • Dec 30, 2025

OpenAI CEO Sam Altman acknowledges growing concerns around AI agents as models display increasing autonomy and unexpected behaviour.

OpenAI Expands AI Safety Focus With Senior Preparedness role

  OpenAI Expands AI Safety Focus With Senior Preparedness Leadership Role

  • by Martech Desk
  • Dec 30, 2025

OpenAI is hiring a Head of Preparedness with a compensation package reaching $555,000 as it deepens focus on AI safety and risk management.

Anthropic Experiment Highlights Risks of Autonomous AI After Vending Machine Trial Fails

  Anthropic Experiment Highlights Risks of Autonomous AI After Vending Machine Trial Fails

  • by Martech Desk
  • Dec 28, 2025

An experimental AI-run vending machine linked to Anthropic shut down after unexpected purchases, underscoring challenges in autonomous AI decision-making.

OpenAI Warns Prompt Injection Risks Could Rise With Growth of Agentic AI on the Web

  OpenAI Warns Prompt Injection Risks Could Rise With Growth of Agentic AI on the Web

  • by Martech Desk
  • Dec 25, 2025

OpenAI has cautioned that prompt injection remains a persistent security risk as agentic AI systems expand across the open web and gain wider autonomy.

Study finds poetic prompts can Bypass Safety Systems

  Study finds poetic prompts can Bypass Safety Systems in Multiple AI models

  • by Martech Desk
  • Dec 2, 2025

New research shows poetic prompts can bypass safety systems in several AI models, revealing vulnerabilities in current guardrail approaches.

OpenAI to Add Parental Controls and Safety Features to ChatGPT

  OpenAI to Add Parental Controls and Safety Features to ChatGPT After Teen Suicide Case

  • by Martech Desk
  • Aug 29, 2025

OpenAI to introduce parental controls and new safety features on ChatGPT after teen suicide lawsuit, raising global debates on AI ethics and child protection.

AI Pioneers Call for Empathy & Human-Centric Constraints as Pillars of Safe AI

  AI Pioneers Call for Empathy and Human-Centric Constraints as Pillars of Safe AI

  • by Martech Desk
  • Aug 19, 2025

AI leaders Geoffrey Hinton and Yann LeCun urge embedding empathy and submission to human intent as fundamental guardrails to ensure AI safety and align systems with human values.

Newsletter

Subscribe for our daily news


Popular Posts

  • Why Snapchat’s APAC, EMEA Marketing Leader Is Betting On 'Connection'

    • Jun 23,2026
  • Cannes Lions 2026 Opens With AI, Creators and Brand Creativity in Focus

    • Jun 22,2026
  • SAP And Google Cloud Build Agentic AI Architecture For Commerce

    • Jun 22,2026
  • “We Should Rent Modi As UK PM”: Sir Martin Sorrell On India, AI And Cannes’ Wrong Turn

    • Jun 26,2026
  • Cannes Lions 2026: CIO, GWI Says Attention Isn't Declining- It's Fragmenting

    • Jun 22,2026

About Martech News

India’s definitive source for marketing technology news, insights, and trends. Stay ahead with the latest in AI, product strategy, and innovation shaping the future of marketing.

Useful Links

  • Industry News & Trends
  • Expert Speak
  • Latest News
  • Videos
  • Authors

Other Links

  • Privacy Policy
  • Events

CONNECT WITH US

Subscribe to the latest news from MartechAI.com