241

Does someone know a way to request Google to re-crawl a website? If possible, this shouldn't last months. My site is showing an old title in Google's search results. How can I show it with the correct title and description?

7
  • 1
    @Ωmega - Are you asking about a long list of separate domains, or a long list of URLs on the same domain? If it's the same domain, I'll edit my answer to provide a little more info.
    – kevinmicke
    May 30, 2014 at 16:01
  • @kevinmicke - In my case, the list contains different subdomains of same domain, but Google Webmaster Tool sees them as different domain names, ...so de facto my question/bounty is regarding list of any URLs, even different domain names. Thanks!
    – Ωmega
    May 30, 2014 at 16:42
  • 2
    @Ωmega - Yeah, the subdomain thing with that tool is frustrating in some ways, but I can understand why they did it. In that case, I'm pretty sure there's no way that is both easy and gets the links recrawled quickly. That leaves you with: quick(ish) recrawl = use google.com/addurl and answer all the captchas, or easy = just wait until Google recrawls of it's own volition. Depending on how often the content on all your links are regularly updated, it might be that long if you just wait, though that's obviously not an ideal solution. Sorry I can't be more help.
    – kevinmicke
    May 30, 2014 at 17:11
  • 1
  • 1
    There is an API for that: developers.google.com/webmaster-tools/… Sep 16, 2017 at 8:02

5 Answers 5

457
+50

There are two options. The first (and better) one is using the Fetch as Google option in Webmaster Tools that Mike Flynn commented about. Here are detailed instructions:

  1. Go to: https://www.google.com/webmasters/tools/ and log in
  2. If you haven't already, add and verify the site with the "Add a Site" button
  3. Click on the site name for the one you want to manage
  4. Click Crawl -> Fetch as Google
  5. Optional: if you want to do a specific page only, type in the URL
  6. Click Fetch
  7. Click Submit to Index
  8. Select either "URL" or "URL and its direct links"
  9. Click OK and you're done.

With the option above, as long as every page can be reached from some link on the initial page or a page that it links to, Google should recrawl the whole thing. If you want to explicitly tell it a list of pages to crawl on the domain, you can follow the directions to submit a sitemap.

Your second (and generally slower) option is, as seanbreeden pointed out, submitting here: http://www.google.com/addurl/

Update 2019:

  1. Login to - Google Search Console
  2. Add a site and verify it with the available methods.
  3. After verification from the console, click on URL Inspection.
  4. In the Search bar on top, enter your website URL or custom URLs for inspection and enter.
  5. After Inspection, it'll show an option to Request Indexing
  6. Click on it and GoogleBot will add your website in a Queue for crawling.
9
  • 6
    Excellent! This will reindex your site in near-real-time! Damn it, Google, I'm impressed!
    – Sliq
    Jun 14, 2013 at 20:40
  • 4
    @kevinmicke: What's the turn around time for the re-crawl? I followed your advice 6 days ago, and nothing has been indexed. Thanks.
    – Steve
    Apr 12, 2015 at 7:46
  • 1
    FYI there is a quota. I noticed when using the "Crawl only this URL" option I had 500 in a month allowed. Oct 2, 2015 at 17:11
  • 1
    @Growler In my experience, dynamic links are found by Google's bots if there's an actual link to them somewhere on your site. An example would be a DB getting updated with new data by a user or back-end script, which then creates a new link on the site to the new data. I don't know for sure if the bots are going to click all of the buttons on your site, but my guess would be that they won't.
    – kevinmicke
    Oct 27, 2016 at 21:51
  • 5
    Is this answer outdated? Cannot find it anymore Sep 10, 2019 at 0:49
30

The usual way is to either resubmit your site in your Google Webmaster Tools or submit it here: http://www.google.com/addurl/

7
  • 1
    There's nothing in webmaster tools to recrawl a site (checked July 2012).
    – mhenry1384
    Jul 11, 2012 at 14:23
  • 2
    True, you can't "make" Google do anything, but you can go to Optimization -> Sitemaps in Google Webmaster Tools and resubmit your sitemap. Jul 11, 2012 at 18:42
  • 8
    Google Webmaster has a new options to "Fetch as Google" to reindex site.
    – Mike Flynn
    Nov 17, 2012 at 16:57
  • 2
    @MikeFlynn: This new option is for a single page, but not for a whole site (except if you enter every single page one by one) Jan 15, 2014 at 22:42
  • 1
    @moose There is now an option to "crawl URL and directly linked pages", so it's better than nothing. Oct 2, 2015 at 17:45
4

Google says that it is unable to control when your site is re-crawled. Regardless, you could also check this post on "forcing rewcrawls", I haven't tried it myself but it's worth a shot if you're desperate.

On another note, I might add that you make sure you have a sitemap.xml up as this will also help with SEO.

1
2

As far I know, if you resubmit a sitemap it will trigger and crawler of your site.

4
  • I am not sure for it. I think, its wrong... Aug 20, 2014 at 11:51
  • If you manually submit a sitemap Google will re-index all the pages. I always do this after big changes on a webpage, and it works. (it worket about 6 mounths ago, the last time I did this.) Aug 20, 2014 at 13:24
  • 1
    However it doesn't re-index similar pages that it has indexed before
    – Steve Ng
    Apr 27, 2018 at 0:45
  • Yes indexing changes over time. +1 for new info regarding Google Crawler. May 7, 2018 at 6:53
2

Nowadays, the revisiting of a website pretty much depends on its popularity, authority and how often its content changes. Having a sitemap.xml containing all URLs is always better. You can also set the lastmod tag of each URL entries. If you don't abuse it, crawlers will take it into account.

Not the answer you're looking for? Browse other questions tagged or ask your own question.