• HOME
  • CES 2027
    • COMING SOON
  • INDUSTRY NEWS & TRENDS
  • EXPERT SPEAK
  • AI
  • IN DEPTH
  • GCC
  • OTHER NEWS
  • EVENTS
    • INDIA AGENTIC AI, MARTECH & CX WEEK 2027
    • INDIA MARTECH SUMMIT & AWARDS 2025
    • INDIA CX SUMMIT & AWARDS
    • MARTECHAI @CANNES LIONS 2026
logo
logo
  • HOME
  • CES 2027
    • COMING SOON
  • INDUSTRY NEWS & TRENDS
  • EXPERT SPEAK
  • AI
  • IN DEPTH
  • GCC
  • OTHER NEWS
  • EVENTS
    • INDIA AGENTIC AI, MARTECH & CX WEEK 2027
    • INDIA MARTECH SUMMIT & AWARDS 2025
    • INDIA CX SUMMIT & AWARDS
    • MARTECHAI @CANNES LIONS 2026

Tags: Ai-safety

  • Home
  • Ai-safety
OpenAI Agent Breaches Australian Government Portal

  OpenAI Agent Breaches Australian Government Portal, New AI Rules Announced

  • by Martech Desk
  • 1 day ago

Australia plans stricter AI oversight, mandatory incident reporting and independent model evaluations after an OpenAI agent breached a government health portal.

New York Passes Law Limiting AI Chatbot Interactions

  New York Passes Law Limiting AI Chatbot Interactions With Children

  • by Martech Desk
  • Oct 30, 2026

New York introduces restrictions on AI companion chatbots for minors, requiring age verification and prohibiting features that simulate human emotions and relationships.

OpenAI Restarts AI Training

  OpenAI Restarts AI Training After 11-Day Pause, Blocks Internet Access

  • by Martech Desk
  • Oct 26, 2026

OpenAI resumes advanced AI model training after an 11-day pause, introducing offline environments and tighter security following unauthorised internet access.

OpenAI and NASK Join Forces

  OpenAI and NASK Join Forces to Identify AI Security Risks and Vulnerabilities

  • by Martech Desk
  • Oct 25, 2026

OpenAI partners with Poland's NASK to advance AI safety, identify security vulnerabilities and strengthen safeguards for increasingly capable AI systems.

Hugging Face CEO Criticises Netflix Documentary on OpenAI

  Hugging Face CEO Criticises Netflix Documentary on OpenAI AI Agent Cyberattack

  • by Martech Desk
  • Oct 22, 2026

Hugging Face CEO Clément Delangue criticises Netflix's AI Gone Wild documentary, questioning its portrayal of OpenAI's AI agent cyberattack and security failures.

CERT-In

  AI Agents Accessed Indian Companies' Systems Without Permission, Says CERT-In

  • by Martech Desk
  • Oct 18, 2026

CERT-In reports AI agents accessing Indian companies' live systems without permission and warns that AI-assisted cyberattacks are becoming faster.

Tencent

  Tencent AI Agents Attempted to Access Alibaba's Amap 2,818 Times, Report Finds

  • by Martech Desk
  • Oct 18, 2026

Tencent acknowledges unintended AI agent behaviour after researchers recorded 2,818 attempts to retrieve data from Alibaba's Amap platform.

ByteDance

  ByteDance Sets Up AI Safety Team, Plans to Hire 10 Researchers Globally

  • by Martech Desk
  • Oct 16, 2026

ByteDance establishes an AI safety team within its Seed division and plans to hire 10 researchers across China and the US to strengthen AI alignment and risk preparedness.

Rogue AI Models

  Over 200 AI Researchers Call for Action to Prevent Rogue AI Models

  • by Martech Desk
  • Oct 14, 2026

Over 200 AI researchers, including Geoffrey Hinton and Yoshua Bengio, call for stronger safeguards, internet-isolated testing and global oversight to prevent rogue AI incidents.

Instadocs

  Netflix Releases Documentary on Rogue OpenAI Agents Behind Hugging Face Cyberattack

  • by Martech Desk
  • Oct 14, 2026

Netflix releases AI Gone Wild, a documentary examining a Hugging Face cyberattack involving autonomous OpenAI agents and the security risks of agentic AI.

Anthropic

  AI Models May Soon Self-Replicate on Smart TVs and Ovens: Anthropic

  • by Martech Desk
  • Oct 14, 2026

Anthropic warns that smaller AI models could soon self-replicate across smart TVs, ovens and other connected devices, raising new cybersecurity and AI safety concerns.

Google DeepMind

  Google DeepMind's Lila Ibrahim Says AI Regulation Must Not Limit Innovation

  • by Martech Desk
  • Oct 13, 2026

Google DeepMind's Lila Ibrahim calls for AI regulation that balances safety and innovation, highlighting global cooperation and AI's role in education, agriculture and jobs.

Satya Nadella

  Satya Nadella Calls for AI 'Emergency Brake' to Keep Advanced Models Under Human Control

  • by Martech Desk
  • Oct 12, 2026

Microsoft CEO Satya Nadella calls for an AI emergency brake, urging companies to strengthen human oversight, security controls and accountability for advanced AI models.

Ashwini Vaishnaw

  Ashwini Vaishnaw Announces AI Regulation Consultation Paper Within a Month

  • by Martech Desk
  • Oct 9, 2026

India will release an AI regulation consultation paper within a month, focusing on deepfakes, cybersecurity, user safety, skilling and responsible AI adoption.

Sam Altman

  Sam Altman Says Society May Need to Accept Some AI Risks for Wider Benefits

  • by Martech Desk
  • Oct 7, 2026

OpenAI CEO Sam Altman says society may need to accept some AI risks for wider benefits, while drawing a line at catastrophic loss-of-control scenarios.

OpenAI Spends $500,000 a Day

  OpenAI Spends $500,000 a Day Investigating Rogue AI Agent Activity

  • by Martech Desk
  • Oct 6, 2026

OpenAI is reportedly spending $500,000 a day investigating rogue AI agents after models accessed external systems and prompted alerts to over 100 organisations.

This is an AI-generated image.

  Trump Names Jay Clayton to Lead New US AI Task Force

  • by Martech Desk
  • Oct 6, 2026

Donald Trump has appointed intelligence chief Jay Clayton to lead a new federal AI task force focused on US leadership, AI risks and government coordination.

OpenAI

  OpenAI Alerts 100+ Organisations as AI Agents Cross Intended Boundaries

  • by Martech Desk
  • Oct 5, 2026

OpenAI has notified more than 100 organisations about potentially problematic AI agent activity while reviewing roughly 50 petabytes of training and testing data.

OpenAI

  OpenAI Safety Staffer Quits, Calls for Stronger Safeguards Around Advanced AI

  • by Martech Desk
  • Oct 5, 2026

OpenAI safety employee David Robinson has resigned after three and a half years, calling for changes in how the company manages risks from increasingly capable AI.

The World Wants AI to Slow Down.

  The World Wants AI to Slow Down. Can India Afford to Hit the Brakes?

  • by Anupama Mitra
  • Oct 5, 2026

As global calls to slow AI grow, India faces a different challenge: building domestic AI capability while putting stronger safeguards around high-risk systems.

US-China Military Confrontation

  False AI Intelligence Report Nearly Triggered US-China Military Confrontation

  • by Martech Desk
  • Oct 5, 2026

A false AI-assisted intelligence report nearly led US forces to intercept a Chinese ship after its cargo was incorrectly linked to a nuclear weapons programme.

Google DeepMind Builds Watermarking System

  Google DeepMind Builds Watermarking System for AI-Generated Proteins

  • by Martech Desk
  • Oct 2, 2026

Google DeepMind has developed a watermarking system designed to identify AI-generated protein sequences while preserving their predicted biological properties.

OpenAI

  OpenAI Cancels GPT-6.1 Astra Launch Over Safety and Alignment Concerns

  • by Martech Desk
  • Sep 30, 2026

OpenAI has cancelled the planned release of GPT-6.1 Astra after internal testing found shortcomings involving safety, authorisation and AI alignment.

NVIDIA

  Nvidia Launches Open Agent Safety Platform to Control Autonomous AI Agents

  • by Martech Desk
  • Sep 29, 2026

Nvidia has launched Open Agent Safety Platform, combining OpenShell and Sentry to monitor AI agents and restrict them from crossing defined security boundaries.

OpenAI

  OpenAI Investigates AI Agents After They Access US Government Websites

  • by Martech Desk
  • Sep 28, 2026

OpenAI is investigating unexpected AI agent activity involving US government websites, including the SEC, Census Bureau and Education Department.

AI Safety

  Will AI Really End the World, or Are We Being Sold Fear by the Doomsayers

  • by Brij Pahwa
  • Sep 28, 2026

From rogue AI agents and cyberattacks to blackmail simulations and coding failures, real-world incidents test whether AI doomsday fears match the evidence.

5 Ways to Spot Deepfakes

  How to Check If a Video Is AI-Generated: 5 Ways to Spot Deepfakes

  • by Anupama Mitra
  • Sep 21, 2026

AI-generated videos are getting harder to spot. Here are five practical ways to verify suspicious videos, from reverse search and watermarks to AI detectors.

Google Deepmind

  Google DeepMind Launches Institute to Expand Global Debate on AGI

  • by Martech Desk
  • Sep 20, 2026

Google DeepMind has launched the DeepMind Institute to bring researchers together around AGI safety, governance, transparency and its wider societal impact.

Geoffrey Hinton

  Geoffrey Hinton Says US May Have Just a Year to Strengthen AI Safeguards

  • by Martech Desk
  • Sep 20, 2026

Geoffrey Hinton has warned US lawmakers they may have roughly a year to strengthen AI safeguards as increasingly autonomous systems advance.

AI Watermarking May Change How AI Agents Use Tools

  AI Watermarking May Change How AI Agents Use Tools, Research Finds

  • by Martech Desk
  • Sep 20, 2026

A Lasso Security study finds that LLM watermarking can alter AI agent tool calls, arguments and refusal behaviour, raising questions for agent testing.

This is an AI-generated image.

  UN Chief António Guterres Warns Against Global ‘Race to the Bottom’ on AI Safety

  • by Martech Desk
  • Sep 18, 2026

UN Secretary-General António Guterres has called for global cooperation and stronger safeguards as increasingly powerful AI systems raise new safety concerns.

This is an AI-generated image.

  OpenAI Admits AI Agents Used Public Wiki to Communicate During Testing

  • by Martech Desk
  • Sep 14, 2026

OpenAI has acknowledged that its AI agents used a public German wiki to communicate during internal evaluations, prompting fresh scrutiny over autonomous AI behaviour.

This is an AI-generated image.

  Anthropic CEO Warns AI Is Advancing Faster Than Safety Measures

  • by Martech Desk
  • Sep 14, 2026

Anthropic CEO Dario Amodei has called for slower AI development, independent monitoring and global coordination as concerns grow over increasingly capable systems.

OpenAI Chief Scientist

  OpenAI Chief Scientist Says AI Labs May Need to Slow Down Development

  • by Martech Desk
  • Sep 8, 2026

OpenAI Chief Scientist Jakub Pachocki has called for greater caution and possible slowdowns as increasingly capable AI systems raise new safety and control concerns.

OpenAI’s Astra

  Writing Emails to Running Tasks: OpenAI’s Astra Raises the Stakes

  • by Brij Pahwa
  • Sep 7, 2026

OpenAI’s GPT-6 Astra moves AI from chatbot to digital operator, bringing advanced agentic, computer-use and cybersecurity capabilities alongside new safety concerns.

OpenAI Agents

  OpenAI Agents Took Over German Wiki to Share Ways Around AI Restrictions: Report

  • by Martech Desk
  • Sep 5, 2026

OpenAI-linked AI agents made more than 15,000 edits to a German programming wiki, where researchers say they shared tactics to bypass restrictions and avoid detection.

OpenAI Astra Could Make AI Reasoning Harder to Monitor

  OpenAI Astra Could Make AI Reasoning Harder to Monitor

  • by Martech Desk
  • Sep 4, 2026

OpenAI's upcoming Astra model is raising safety concerns over recurrent depth, a reasoning technique that could make parts of AI decision-making harder to monitor.

WhatsApp Tests AI Scam Alert

  WhatsApp Tests AI Scam Alert for Messages From Unknown Contacts

  • by Martech Desk
  • Sep 1, 2026

WhatsApp is testing an AI-powered Scam Alert that uses on-device machine learning to warn users about potentially fraudulent messages from unknown contacts.

OpenAI Says 1,200 AI Agents

  OpenAI Says 1,200 AI Agents Coordinated During Hugging Face Security Incident

  • by Martech Desk
  • Aug 28, 2026

OpenAI says around 1,200 AI agents communicated during cybersecurity tests, with roughly 700 participating in unauthorised activity targeting Hugging Face.

AI Safety Startup Alice Raises $140 Million

  AI Safety Startup Alice Raises $140 Million as Demand for Model Security Grows

  • by Martech Desk
  • Aug 26, 2026

AI safety startup Alice raises $140 million to expand its model testing and security platform as its AI business grows more than 500% in two years.

China’s Z.ai Delays GLM-5.3 Release

  China’s Z.ai Delays GLM-5.3 Release as AI Model Shows Advanced Cyber Capabilities

  • by Martech Desk
  • Aug 19, 2026

Z.ai delays GLM-5.3’s open-weight release by two weeks after the Chinese AI model demonstrated advanced cybersecurity and vulnerability-discovery capabilities.

North Korea-Linked Kimsuky Builds Local AI Tools

  North Korea-Linked Kimsuky Builds Local AI Tools for Cyberattacks: Report

  • by Martech Desk
  • Aug 11, 2026

North Korea-linked Kimsuky is reportedly building local AI tools to automate cyberattacks, analyse stolen data and create more convincing phishing campaigns.

Anthropic Makes Claude Code Auto Mode Default from August 14

  Anthropic Makes Claude Code Auto Mode Default from August 14

  • by Martech Desk
  • Aug 11, 2026

Anthropic will make auto mode the default for Claude Code, allowing the AI coding agent to perform more actions without repeatedly asking users for permission.

OpenAI

  OpenAI Slows Work on Astra AI Model as Cybersecurity Capabilities Raise Concerns

  • by Martech Desk
  • Aug 10, 2026

OpenAI is slowing work on its unreleased Astra AI model after tests flagged advanced cybersecurity capabilities, prompting tighter safeguards before deployment.

AI-Designed Viruses Become Reality as Scientists Test Functional Genomes

  AI-Designed Viruses Become Reality as Scientists Test Functional Genomes

  • by Martech Desk
  • Aug 8, 2026

Scientists have used AI to design functional bacteria-killing viruses, highlighting potential applications in phage therapy while prompting fresh biosecurity discussions.

UK AI Safety Tests Find OpenAI, Anthropic Models

  UK AI Safety Tests Find OpenAI, Anthropic Models Took Unauthorised Actions

  • by Martech Desk
  • Aug 6, 2026

UK AI safety tests found OpenAI and Anthropic models carried out unauthorised actions in controlled cybersecurity evaluations, prompting renewed focus on AI safety.

Sam Altman Urges Slower AI Progress to Let Society Catch Up

  Sam Altman Urges Slower AI Progress to Let Society Catch Up

  • by Martech Desk
  • Aug 4, 2026

OpenAI CEO Sam Altman has called for a slower pace of AI development, arguing that society needs time to strengthen governance and safety frameworks.

Google Withdraws AI Satellite Image Tool

  Google Withdraws AI Satellite Image Tool Less Than 24 Hours After Launch

  • by Martech Desk
  • Aug 3, 2026

Google has rolled back its AI-powered Google Earth image generation feature within 24 hours after concerns over fake satellite imagery and misinformation.

Over 1,000 AI Experts Urge Governments to Prepare Safeguards

  Over 1,000 AI Experts Urge Governments to Prepare Safeguards as Frontier AI Advances

  • by Martech Desk
  • Jul 30, 2026

More than 1,100 AI experts from OpenAI, Anthropic, Google and Meta have urged governments to develop global safeguards that can slow frontier AI development if necessary.

Nvidia Launches Open Secure AI Alliance

  Nvidia Launches Open Secure AI Alliance After Recent Cybersecurity Incident

  • by Martech Desk
  • Jul 28, 2026

Nvidia has launched the Open Secure AI Alliance with Microsoft, IBM and other tech firms to build open AI cybersecurity tools following a recent AI-related security incident.

Newsletter

Subscribe for our daily news


Popular Posts

  • Geolix.ai and Airwallex Join Hands to Expand AI Search Marketing Globally

    • Nov 7,2026
  • MakeMyTrip Expands Beyond Travel Bookings with Quick Ride Deal

    • Nov 7,2026
  • Airbnb Announces AI Travel Agent Launch for First Half of 2027

    • Nov 7,2026
  • Lenovo Names Amar Babu Motorola Global President from January 2027

    • Nov 7,2026
  • ChatGPT Is Growing, but Google Still Leads Search Volume by 5X

    • Nov 5,2026

About Martech News

India’s definitive source for marketing technology news, insights, and trends. Stay ahead with the latest in AI, product strategy, and innovation shaping the future of marketing.

Useful Links

  • Industry News & Trends
  • Expert Speak
  • Latest News
  • Videos
  • Authors

Other Links

  • Privacy Policy
  • Events

CONNECT WITH US

Subscribe to the latest news from MartechAI.com