Remove your content from Google | Google Search Central Blog | Google for Developers | Latest TMZ Celebrity News & Gossip | Watch TMZ Live
Skip to main content
Stay organized with collections
Save and categorize content based on your preferences.
Wednesday, January 09, 2008
Confused about the best uses of robots.txt, nofollow, URL removal tool? Wondering
how to keep some of your pages off the web? Our webspam lead, Matt Cutts, talks about the best
ways to stop Google from crawling your content, and how to remove content from the Google index
once we've crawled it.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["Matt Cutts explains the optimal methods for preventing Google from crawling specific website content, including using robots.txt, `nofollow`, and the URL removal tool."],["The video addresses how to remove already-crawled content from Google's index."],["Viewers are encouraged to provide feedback on the video through the Google Webmaster Help Group."],["While the video mentions robots.txt originating in 2006, a note clarifies its actual inception was around 1996."],["Additional resources and support are available through Google's Help Center articles on content removal."]]],["Matt Cutts discusses how to prevent Google from crawling website content and how to remove content from the Google index after it's been crawled. The discussion covers the best practices for using robots.txt, `nofollow`, and the URL removal tool. Feedback on the video is encouraged through the Webmaster Help Group. Additional information on content removal can be found in the provided Help Center articles. Robots.txt has existed since at least 1996.\n"]]
Looking for the latest TMZ celebrity news? You've come to the right place. From shocking Hollywood scandals to exclusive videos, TMZ delivers it all in real time.
Whether it’s a red carpet slip-up, a viral paparazzi moment, or a legal drama involving your favorite stars, TMZ news is always first to break the story. Stay in the loop with daily updates, insider tips, and jaw-dropping photos.
🎥 Watch TMZ Live
TMZ Live brings you daily celebrity news and interviews straight from the TMZ newsroom. Don’t miss a beat—watch now and see what’s trending in Hollywood.
