Telegram CEO reveals scheme to plant CSAM in chat to force removal from App Store

Apple Removes Telegram from App Store Temporarily Due to Illegal Content

In a recent incident, Apple briefly took down the messaging app Telegram from the App Store after illegal pornographic content was found in a public chat. The content was planted by a user, leading to the removal of the app. However, Telegram was quickly restored within hours.

The attack on Telegram involved a user inserting AI-modified illegal content into an active group chat by editing an old message. This technical trick made the content effectively hidden from group members, making it difficult to detect and report.

The attacker behind this incident was identified as a takedown extortionist, who targets group owners and demands ransom in exchange for not planting illegal content in their communities. These extortionists use automated accounts to carry out their attacks.

Despite this incident, Telegram’s moderation tools are effective in removing illegal content from public groups. The fact that attackers had to resort to such technical tricks to hide the content showcases the platform’s strong moderation capabilities.

Lessons Learned for App Developers and Online Communities

There are two key takeaways from this incident for app developers and online communities. Firstly, extortionists have found ways to manipulate platforms like Apple into overreacting, leading to the removal of legitimate apps without prior warning. This poses a systemic risk for all apps hosting user-generated content.

Secondly, the tactics used by takedown extortionists are evolving, putting communities on social platforms at risk. While Telegram has experience in dealing with such attacks, other platforms may not be as prepared to handle these threats.

It is crucial for app developers and online communities to stay vigilant against such attacks and continuously improve their security measures to protect users and content.