Elon Musk recently shared a screenshot of an AI-assisted purchase that leaked sensitive information, including a 10-digit order number, full address, and partial payment details.
This exposure allowed external users to impersonate the account owner via the vendor's customer service chatbot to modify shipping details and order quantity.
The event highlights systemic risks in the integration of AI agents with legacy customer support systems and the dangers of leaking state identifiers in shared UI screenshots.
The intervention of other users
An X user used the email and order number to contact Lego's automated customer service system and was reportedly able to cancel the order. A few hours later, Musk tweeted that his order had not been canceled after all.
Another user then allegedly used the same details in the company's customer service system to reorder the delivery, increase the quantity to 400 sets, and change the delivery address. When contacted by reporters to confirm the events, Lego declined to comment.
The dangers of automated shopping
The incident came shortly after Musk suggested that X users let digital assistants make online purchases by uploading a photo of their credit card.
For its part, Visa had warned since the end of last year about the risks of fraud in automated shopping through artificial intelligence, as well as the increase in transactions initiated by automated programs with malicious intent.
Top comments (0)