What Is The Importance Of Robot.txt Page?

Money Making Forum - e-gold autosurf hyip mlm discussion | monitor. A place where leaders meet and grow! This is a positive community. Post your opportunity here. More investment Module coming soon.

Place your 468x60 banner below for as low as $87 for 5 days

-Paid Advertisement- DTM does not endorse any of the program advertised

DreamTeam Money Making Forum Register

Contact Us Rules Link To Us Blog Directory Advertise on DTM Help Log In

Welcome Guest ( Log In | Register )

Place your Rotating 728x90 banner below for as low as $176 for 5 days or Non Rotating banner for $1130 for 5 days

-Paid Advertisement- DTM does not endorse any of the program advertised

DreamTeamMoney Forum > Internet Marketing, Affiliate Marketing, SEO, Marketplace, Webmaster & Social Media Lounge > Internet Marketing, Affiliate Marketing, SEO, Marketplace & Webmaster Lounge > Search Engine Optimization (SEO) > SEO Discussion

What Is The Importance Of Robot.txt Page?

post

Apr 5 2014, 07:45 AM

Post #1

Active Money Maker

Group: Members
Posts: 121
Dream Points: 1,184
Experience Points: 171

Joined: 5-April 14
Member No.: 483,668

What is the importance of robot.txt page? Is it important to use this page in our website from SEO points of view?

User is offline

Go to the top of the page

Quote Post

Reply to this topic

Start new topic

Replies(1 - 8)

searchnmeet	Apr 7 2014, 05:35 AM Post #2
Active Money Maker Group: Members Posts: 155 Dream Points: 1,460 Experience Points: 211 Joined: 22-February 14 Member No.: 474,447	No because robot used for hiding the page, and google want to see all pages. -------------------- best restaurants in delhi \| pet shops in delhi \| best hotels in delhi \| local and global search engine \| restaurant in delhi

RH-Calvin	Apr 7 2014, 06:20 PM Post #3
Elite Money Maker Group: Members Posts: 4,302 Dream Points: 40,948 Experience Points: 4,372 Joined: 4-June 13 Member No.: 393,863	Robot.txt file is used to disallow certain webpages on your website from search engine crawling. These pages are viewable by human interface, but search engines never crawl or indexed them. It is an important On Page SEO for your website, restricting search engine access to certain web pages on your website. -------------------- █ Cheapest VPS \| $1 VPS Hosting █ Windows VPS Hosting \| Windows with Remote Desktop █ Cheap Dedicated Server \| $29 Dedicated Server █ Free Setup and IPMI \| Unmetered Bandwidth Promo

aakkam	Apr 8 2014, 11:25 AM Post #4
New Money Maker Group: Members Posts: 12 Dream Points: 170 Experience Points: 62 Joined: 18-March 14 Member No.: 479,874	To deny or to disallow the the pages from your site use robot.txt files. In many cases instead of avoiding 404 page error robot.txt file is used. Search engine will read that robot file and start redirecting the user or it will invisible the page. -------------------- http://www.chennaireliancedatacard.in

smith5	Apr 8 2014, 11:37 AM Post #5
Junior Money Maker Group: Members Posts: 56 Dream Points: 564 Experience Points: 107 Joined: 29-November 13 Member No.: 454,330	Robot.txt file help to block search engine bots from crawling certain pages in your websites like secure pages or pages with sensitive date -------------------- Best Formal Shirts Best Formals for Men Formal Shirt Clothes Half Hand Shirts

MasterChhaya	May 6 2014, 10:28 AM Post #6
Active Money Maker Group: Members Posts: 400 Dream Points: 4,013 Experience Points: 450 Joined: 23-April 14 From: Surat, India Member No.: 487,764	Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines, but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site and the fact that you put a robots.txt file is something like putting a note �Please, do not enter� on an unlocked door -------------------- Buy cakes online in surat, Buy Flowers online in surat,buy cakes in Surat,Buy flowers in Surat,Send Flower to Surat,Send cakes to Surat,Buy bridal sarees online india,buy wedding sarees online india

AradhyaKadam	Aug 27 2015, 05:19 AM Post #7
Active Money Maker Group: Members Posts: 138 Dream Points: 1,406 Experience Points: 188 Joined: 15-July 15 Member No.: 554,982	Robots.txt files are useful: 1. If you want search engines to ignore any duplicate pages on your website 2. If you don�t want search engines to index your internal search results pages 3. If you want to tell search engines where your sitemap is located -------------------- ecommerce platform in india \| build online store in india \|Create Online Store in India \| E-commerce webdesign company in India\|How to start ecommerce business in India \| ways to start online business in India

krishnanayak	Aug 27 2015, 11:15 AM Post #8
Active Money Maker Group: Members Posts: 166 Dream Points: 1,710 Experience Points: 216 Joined: 24-July 15 Member No.: 555,900	A robots.txt file gives instructions to web robots about the pages the website owner doesn�t wish to be �crawled�. For instance, if you didn�t want your images to be listed by Google and other search engines, you�d block them using your robots.txt file. - See more at: https://www.hallaminternet.com/2014/the-imp...h.3SF3rJLa.dpuf Hair building fiber \| \| Allaah Barkat Locket \| -------------------- Air Sofa \| Asthijivak \| Fat Cutter \| Slim Shaper \| Roop Amrit \| Sandhi Sudha \| Hot Shaper \| Shakti Prash

ketul	Aug 28 2015, 06:09 AM Post #9
Elite Money Maker Group: Members Posts: 3,168 Dream Points: 31,610 Experience Points: 3,218 Joined: 25-April 14 From: Bangalore Member No.: 488,318	The robots exclusion protocol (REP), or robots.txt is a text file webmasters create to instruct robots (typically search engine robots) how to crawl and index pages on their website. -------------------- PHP Web Development Company Bangalore \| Joomla Ecommerce Web Design Company Bangalore \| Ecommerce Web Development Company in Bangalore

« Next Oldest · SEO Discussion · Next Newest »

Featured Sites:

FREE Social Promotion

Open a Real Forex Trading Account

Superchange - Instant E-currency Exchange

Monetize yourself while giving support to original creators

Join the fastest growing cryptocurrency exchange

Sponsor Ads:

Advertisement

Follow Us:

Dream Team Money Forum

Follow @DreamTeamMoney

Join DreamTeamMoney News Telegram Channel

Related Topics

Related Topics

Topic Title	Replies	Topic Starter	Views	Last Action
What Is Sepa And How Does It Work?	13	radex78	1,211	Oct 3 2024, 02:18 AM Last post by: uncle gober
What Is The Forex Market And Currency Trading?	42	Puppies	5,650	Oct 2 2024, 03:56 PM Last post by: AaronFX
What Is The Best Online Dating Site?	24	mdolla	9,339	Sep 27 2024, 01:41 AM Last post by: rosario1991
What Is Google Analytics?	71	Stuart S	5,575	Sep 26 2024, 10:14 AM Last post by: Jaya Sharma
What Do You Think Before Starting Trade??	102	dataentry222	9,520	Sep 24 2024, 06:51 PM Last post by: fxGurru

Reply to this topic

Start new topic

1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)

0 Members:

Display Mode: Switch to: Standard · Linear+ · Switch to: Outline

Track this topic · Email this topic · Print this topic · Subscribe to this forum

-Paid Advertisement- DTM does not endorse any of the program advertised

Lo-Fi Version

Advertise on DTM | Rules | Disclaimer | Privacy Policies

Time is now: 7th October 2024 - 09:02 AM

© 2005 - 2018 All Rights Reserved
www.dreamteammoney.com Money Making Forum