Google: When Redirecting URLs Upload and Keep Old Sitemap for 6 Months
John Mueller, a Webmaster Trends Analyst at Google, confirmed this week in a Google Hangout that when redirecting content to new URLs you should upload a copy of the old sitemap so that Google can pick up on the redirects faster.
Furthermore, Mueller said that you should only keep the old sitemap in place for a maximum of 6 months.
This advice is likely to prove useful after migration to a new domain, migration to HTTPS, or after a website re-design that causes the URL structure to change.
While it is recommended to try and keep the same URL structure, to avoid the need for 301 redirects, it is not always possible.
I covered in a previous article how 301 redirects are treated similarly to how links are treated, with roughly 10 - 15 percent of your PageRank decaying each time.
Despite that, Gary Illyes commented in that article that there was no need to update external links, provided your 301 redirects are implemented correctly.
I doubt the old reference to 10-15 percent is still correct. More recently, Gary Illyes implied that any PageRank loss is minimal:
@pip_net if your redirects are properly implemented, the benefit from doing that is so minimal that IMO it's not worth it.— Gary "鯨理／경리" Illyes (@methode) July 7, 2015
The problem with 301 redirects, is that the links pointing to the old URLs will not be counted toward the new URL until the old URL is re-crawled by Google.
Furthermore, when most webmasters make changes to their website structure, the sitemap is updated with the new URLs. It can, therefore, take a very long time for the old URLs to be re-crawled and for Google to recognize that there is a redirect in place.
The solution is to upload a copy of the old sitemap to webmaster tools along with the new version. This will expedite Google finding the redirects, indexing the new pages, as well as removing the old pages from the SERPs in the process.
This tactic of uploading the old sitemap is well regarded as best practice when it comes to migrating URL structures. In the Hangout, John Mueller stressed that you should not leave the old sitemap file there forever. He recommended that you should remove the old sitemap from Google after just six months.
We have transcribed the relevant part of the Google Hangout (time 32:05) below:
You could submit them as a sitemap file. And say these URLs have all changed recently with the last modification date and we will take that last modification date and say oh well, we will try to re-crawl these URLs to see what you changed there. Based on that, we’ll probably re-crawl them a bit faster and try to re-index them a bit faster, with that redirect in place. Meaning, they will drop out, so that could help for a period of time.
I wouldn’t leave that sitemap file in place forever, I’d maybe remove it after half a year because it is pointing at URLs that you don’t want to care about anymore.
You can view the video at the relevant time below:
One thing to note is that you should ideally keep the 301 redirects in place forever to allow for old links to be crawled again. As the old links are re-crawled, the signals will then pass to the new URL. After you believe all the old links have been re-crawled, technically, you can remove the 301 redirects. However, sometimes it can take many months for this process to take place.
Illyes confirmed the position over several tweets:
@Trey_Collier you will not get credited for any new links if the old page is nonexistent / doesn't redirect— Gary "鯨理／경리" Illyes (@methode) April 27, 2016