How Google Finds and Indexes a New Website

Search page on a screen

A new website can sit online for weeks without showing up in Google. That is normal, and it rarely means something is broken. Google has to find your pages, read them and decide where they belong before anyone can see them in search results. Knowing how that works helps you spend your time on the right jobs.

The good news is that most of the setup is free. You need a little patience, a clear site structure and a free Google account. This guide walks through how Google finds a new site and what you can do to help it along.

How Google discovers a new website

Google explains that Search works in three stages. These are crawling, indexing and serving results. Its own guide to how Google Search works notes that not every page makes it through each stage. A page has to be found and stored before it can ever be shown.

Crawling is the discovery step. Automated programs download the text, images and videos on pages they find. Most new pages are found by following a link from a page Google already knows. You can also hand Google a list of your pages, which is called a sitemap.

Some pages are not crawled at all. A site owner may block them, or they may sit behind a login. Google also renders pages using a recent version of Chrome and runs any JavaScript it finds. That matters because many modern sites load their content with JavaScript.

What indexing means for your pages

Once a page is crawled, Google tries to work out what it is about. It reads the text, the title and other signals on the page. This stored information is the index, and only indexed pages can appear in search results.

Google also looks for pages that are near copies of each other. It groups similar pages and picks one as the canonical version. The canonical is the page that may be shown in results. If your site has several pages saying much the same thing, only one of them is likely to be shown.

Indexing is not guaranteed. Google says a page may be left out if the quality of its content is low. Pages can also be kept out by robots meta rules that tell search engines not to index them. A quick check of your page settings can save a lot of confusion later.

Set up Google Search Console

Google Search Console is a free tool for site owners. It shows which of your pages are indexed and flags problems Google has found. You verify that you own the site, then the reports start to fill in over the following days. It is the closest thing you have to a direct line into how Google sees your website.

Search Console also has a URL Inspection tool. You can paste in a single address and ask Google to crawl it. Google notes that there is a quota for these requests and that resubmitting the same page does not speed things up. You must be an owner or full user of the Search Console property to make a request.

Crawling can take anywhere from a few days to a few weeks. Requesting a crawl does not promise the page will appear quickly, or at all. Keep that in mind before you start changing pages that are only a week old.

Submit a sitemap

A sitemap lists the pages you want Google to know about. Google’s page on how to build and submit a sitemap says many content management systems create one automatically. WordPress, Wix and Blogger are among the platforms it names. If your site runs on one of these, you may already have a sitemap without knowing it.

There are a few simple rules worth knowing. A single sitemap is limited to 50MB uncompressed or 50,000 addresses. Every address should be a full web address rather than a short path. Google accepts XML, RSS, Atom and plain text formats, and it has no preference between them.

You can submit a sitemap through the Sitemaps report in Search Console. You can also add a Sitemap line to your robots.txt file. Google treats a submitted sitemap as a hint, so it may not download or use it straight away. It ignores the priority and change frequency values, and only uses the last modified date when it is consistently accurate.

Help Google understand your site

Links between your own pages make discovery easier. A new service page with no links pointing to it is hard for Google to find. Add it to your menu or link to it from a related page with clear words that describe it. Our post on SEO tactics to boost your website’s visibility covers more of the basics.

Write one clear page for each main service or topic. Avoid publishing several pages that say almost the same thing with a different suburb name. Give each page a plain title that matches what people search for. Simple, honest pages are easier for Google to read and easier for visitors to trust.

Google also states that it does not accept payment to crawl a site more often or rank it higher. Be wary of anyone who promises guaranteed placement for a fee. If you plan to hire help, our list of questions to ask an SEO firm is a good place to start.

Why a page can be indexed but still not show

Being in the index is only the first hurdle. When someone searches, Google looks through its index for matching pages. It then returns the results it considers the most relevant and highest quality. Google says relevance is decided by hundreds of factors.

Some of those factors relate to the person searching. Their location, language and device can all change what they see. A plumber in Perth may show up for a nearby searcher but not for someone in Sydney. That is why two people can get different results for the same words.

A page may also be indexed yet rarely shown because its content does not match what people search for. Low quality content can hold it back as well. Over time, an SEO rank tracker can help you see which of your pages are starting to appear. Watch the trend over several weeks rather than checking every day.

Search keeps changing as Google adds automated systems and new features. The basics of being found have stayed much the same, though. Our post on marketing in the age of algorithms looks at the bigger picture. Clear pages, sensible links and a working sitemap still do most of the heavy lifting.

Frequently asked questions

How long does it take for a new website to show up on Google?

Google says crawling can take anywhere from a few days to a few weeks. Showing up in results can take longer again. There is no fixed timeframe and no guarantee of inclusion.

Do I have to pay Google to be listed?

No. Google states that it does not accept payment to crawl a site more often or to rank it higher. Google says ranking is done programmatically, so be wary of anyone selling guaranteed placement.

Do I need to make my own sitemap?

Often you do not. Many platforms, including WordPress, Wix and Blogger, build one for you. You can find it and submit it through Search Console.

Why is my page in Search Console but not in results?

An indexed page still has to compete with other pages for each search. Google may judge it less relevant or lower in quality than other options. Improving the content and linking to it from related pages can help over time.