RGB Webtech

RGB Webtech

Meta Robots Noindex | Meta Name Robots

Robots meta directives (sometimes called

Meta Robots Noindex

Meta Robots Tag SEO

Meta Robots Tag SEO | Robot Txt Noindex

How to use Meta Robots Tag on your website? How do you explain to a spider of a search engine you only want it to index just the first page of your website or that it is allowed to index the whole website? You use a specific HTML meta tag for the so-called meta robots tag.

<meta name="robots" content="selection">

Example: How to use the meta robots tag?

Add the following robots meta tag in the HTML source of your website page:

<meta name="robots" content="index, follow">

The spider will now index your whole website.

The spider will not only index the first web-page of your website but also all your other web-pages.

You are also allowed to type it like this:

<meta name="robots" content="index, follow"> <META NAME="ROBOTS" CONTENT="INDEX, FOLLOW"> <META NAME="robots" CONTENT="index, follow"> <meta name="robots" CONTENT="all">

By changing the index to no-index and the follow to no-follow you can influence the behavior of the spider. If you don't want the search engine spider to crawl through your whole website you use the following meta tag:

<meta name="robots" content="index, nofollow">

The spider will now only look at this page and stops there.

<meta name="robots" content="noindex, follow">

The spider will not look at this page but will crawl through the rest of the pages on your website.

<meta name="robots" content="noindex, nofollow">

The spider will not look at this page and will NOT crawl through the rest of your web-pages.

This meta tag can also be typed with the / in the end of the tag:

<meta name="robots" content="index, nofollow" /> <meta name="robots" content="noindex, follow" /> <meta name="robots" content="noindex, nofollow" />

Where do you add this meta name robot tag?

You add this robot tag on the first index page and you tell the spider if you want your whole website to be crawled or not. Make sure that on every page relevant meta tags are added. Add keywords and phrases that are relevant and correspond with the text and the language on that specific page. It might be a lot of work to add specific meta tags to each page but you will notice in time that it works!

Tags: Robots Meta Tag, Meta Robots Noindex, Meta Name Robots, Meta Robots Tag SEO, Robot Txt Noindex

Our popular blog

Web Design, Web Development, Digital Marketing, App Development etc.

Do you want to explore our recent blog?

Complete SEO Checklist

SEO Websites List, SEO Checker Websites List, SEO Tool Websites List

Do you want to explore our SEO Checklist?

Our Packages

Web Design Packages, Web Development Packages, SEO Packages, SMO Packages, PPC Packages, Logo Design Packages etc.

Web Design

Package

$1299

eCommerce Web Design

Package

$1499

SEO

Package

$225Monthly

SMO

Package

$299Monthly

Logo Design

Package

$70

Banner Design

Package

$90

Do you want to explore our packages?