Guides

AI Content Farms and Engagement Bait: How to Spot Them

You have probably seen them. A photo of a child with a birthday cake and the line "nobody ever likes my pictures". A soldier, an old woman, a sculpture made of vegetables. The image looks almost real. The comments are full of "amen" and "happy birthday".

Many of these images were never taken by anyone. They were generated, posted in bulk, and tuned to get a reaction from you. This guide explains how that works, how to recognise it, and what to do instead of reacting.

What an AI content farm is

A content farm is a page, or a group of pages, that publishes as much content as it can at low cost. AI image tools made this much cheaper. One person can now post dozens of new images a day.

Researchers at the Stanford Internet Observatory and Georgetown's Center for Security and Emerging Technology studied 125 Facebook Pages that each posted at least 50 AI-generated images. In their 2024 paper, a preprint, they sorted the pages into spam, scam and other creator pages, and found that some were run in coordinated groups by the same people. They also reported that one AI image post was among the 20 most-viewed posts on Facebook in one quarter of 2023.

The same researchers found that the feed showed these images to many people who did not follow the pages. That is the key point. You do not have to follow a page to see its posts. If you react, you are likely to see more.

How they make money

Reported and researched motives fall into a few groups:

• Platform payouts. Some platforms pay creators for views or engagement. In 2024, 404 Media reported that people were posting viral AI images to earn money from a bonus program for creators. The platform said it acts against inauthentic engagement, whether AI is used or not.
• Traffic to outside sites. The Stanford and Georgetown researchers found spam pages that used clickbait to send people to low-quality websites full of ads.
• Selling the page. A page with many followers can be sold or renamed later. The same study reported that some pages appeared to be building followers to raise their resale value.
• Scams. The study also described scam pages that tried to sell products that did not exist or to collect people's personal details.

In every case, your reaction is the raw material. A like or a comment is not just a kind gesture to the person in the picture. It is a signal that helps the page grow.

Signs to look for

No single sign proves anything. Several together are a strong hint.

• Very high posting volume. Many new images every day, at all hours, with no gaps.
• The same face or style again and again. The same smooth skin, the same lighting, the same kind of scene in post after post.
• Captions that ask for a reaction. "Nobody likes my work", "it's my birthday", "type amen", "share if you agree". The caption is about you reacting, not about the picture.
• No source, place or date. A real photo usually has a story: where, when, who took it. Farm posts rarely have any of that.
• Comments that look the same. Long lists of nearly identical replies, often from new or empty accounts.
• A page history that does not fit. A page about gardening that was a page about something else last year. Many platforms show when a page was created and whether it changed its name.
• Links that leave the platform. A link in the comments or the profile to a site you do not know, especially one full of ads or asking for details.

To check an image itself, use the steps in our guide on how to tell if a photo is real or AI-generated.

What to do instead

1. Do not react. No like, no comment, no share, not even to say it is fake. Arguing in the comments is engagement too.
2. Check before you share. If you want to share something, find the original source first. If you cannot find one, do not share it as real.
3. Report it. Use the report option and choose the closest reason, such as spam, scam or fake account. Platforms have rules against spam and inauthentic behavior, and reports help them act.
4. Tell people you know. Older relatives are often the target of emotional posts. A short, friendly explanation helps more than a public argument.
5. Hide or block the page. This changes what your own feed shows you.

Platforms are also acting. Meta said that in the first half of 2025 it took action on about 500,000 accounts for spammy behavior or fake engagement, as reported by NBC and others, and that accounts which repost content without credit can lose reach and monetization. Rules change often, so check each platform's own policy pages.

The problem is deception, not AI

AI image tools are not the enemy. Artists use them, and AI art that is clearly labeled is an honest creative choice. The problem starts when a generated image is presented as a real photo, with no label, to get your reaction, your money or your details.

That difference matters. It is why we focus on making real photos easy to check, not on attacking AI. For more on what unlabeled AI images do to trust online, read the photos nobody took.

How Rawly handles it

Rawly is a photo and video challenge app. We do not try to detect AI images. We built the app so the question is easy to answer inside it.

• No upload path. Photos and videos are taken with the camera inside the app. There is no gallery upload and no file upload.
• A code on every shared photo. Anyone can type it at rawly.app/verify and see Rawly's copy of the photo and the minute it was taken.
• Limits we say out loud. The code proves when a photo was taken in Rawly, not who took it. It only covers photos taken in Rawly. Someone can still point the camera at a screen, which is why other people can report a post.

Read more about how we keep fake accounts out on a social network with no bots.

Questions

What is an AI content farm?

It is a page or group of pages that posts large amounts of AI-generated images or text, mainly to collect views, likes and followers. The goal is usually money: platform payouts, clicks to outside sites, selling the page later, or scams.

Why do these pages post emotional images?

Emotion gets reactions, and reactions tell a feed to show a post to more people. Images of babies, old people, soldiers, animals or birthdays that ask for a like or a comment are a common pattern.

Is it harmful to like or comment on these posts?

Often it helps the page grow. Each reaction can push the post to more people and makes the page more valuable to its owner. Researchers have reported that some of these pages send people to low-quality sites or try to sell products that do not exist.

Is all AI-generated content bad?

No. AI art that is clearly labeled is a creative choice. The problem is deception: AI images shown as real photos, with no label, to get reactions, money or personal details.

How do I report an AI spam page?

Use the report option on the post or the page and choose the closest reason, such as spam, scam or fake account. Each platform has its own rules on spam and inauthentic behavior. Do not comment to argue, because that also counts as engagement.

Can Rawly stop AI images?

Inside Rawly, there is no way to upload a file. Photos and videos are taken with the camera in the app, and every shared photo carries a code anyone can check at rawly.app/verify. Rawly does not scan or judge content on other apps.