Cross-submissions via robots.txt on Sitemaps.org | Google Search Central Blog | Google for Developers | Latest TMZ Celebrity News & Gossip | Watch TMZ Live
Skip to main content
Stay organized with collections
Save and categorize content based on your preferences.
Thursday, February 28, 2008
Last spring, the Sitemaps protocol was expanded to include the
autodiscovery of Sitemaps using robots.txt
to let us and other search engines supporting the protocol know about your Sitemaps. We
subsequently also announced support for
Sitemap cross-submissions using Google Webmaster Tools,
making it possible to submit Sitemaps for multiple hosts on a single dedicated host. So it was
only time before we took the next logical step of marrying the two and allowing Sitemap
cross-submissions using robots.txt. And today we're doing just that.
How would this work? Say for example you want to submit a Sitemap for each of the two hosts you
own, www.example.com and host2.google.com. For simplicity's sake, you
may want to host the Sitemaps on one of the hosts, www.example.com. For example, if
you have a Content Management System (CMS), it might be easier for you to change your robots.txt
files than to change content in a directory.
You can now exercise the cross-submission support via robots.txt (by letting us know the location
of the Sitemaps):
By indicating in each individual host's robots.txt file where that host's Sitemap lives you are
in essence proving that you own the host for which you are specifying the Sitemap. And by
choosing to host all of the Sitemaps on a single host, it becomes simpler to manage your Sitemaps.
We are making this announcement today on
Sitemaps.org as a joint
effort. To see what our colleagues have to say, you can also check out the blog posts published
by Yahoo! and
Microsoft.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["Google, Yahoo!, and Microsoft now support cross-submissions of Sitemaps using robots.txt, simplifying Sitemap management."],["Webmasters can host Sitemaps for multiple websites on a single server and reference them in each site's robots.txt."],["This update allows easier management of Sitemaps, especially for those using Content Management Systems (CMS)."],["Using robots.txt for cross-submissions helps verify website ownership by specifying the Sitemap location."],["This change is a collaborative effort announced on Sitemaps.org, with supporting information available on Yahoo! and Microsoft blogs."]]],["Webmasters can now manage Sitemaps for multiple hosts from a single host using robots.txt. This allows indicating Sitemap locations for different hosts within each host's respective robots.txt file. For example, `www.example.com`'s robots.txt would point to its Sitemap, and `host2.google.com`'s robots.txt would point to its respective Sitemap, both hosted on `www.example.com`. This cross-submission method via robots.txt simplifies Sitemap management and verifies host ownership. This is a collaborative effort among Sitemaps.org, Yahoo!, and Microsoft.\n"]]
Looking for the latest TMZ celebrity news? You've come to the right place. From shocking Hollywood scandals to exclusive videos, TMZ delivers it all in real time.
Whether it’s a red carpet slip-up, a viral paparazzi moment, or a legal drama involving your favorite stars, TMZ news is always first to break the story. Stay in the loop with daily updates, insider tips, and jaw-dropping photos.
🎥 Watch TMZ Live
TMZ Live brings you daily celebrity news and interviews straight from the TMZ newsroom. Don’t miss a beat—watch now and see what’s trending in Hollywood.
