Zaloguj | Zarejestruj | FAQ
Anonymous

robots.txt

+ Odpowiedz

Posty: 6 Strona 1 z 1


robots.txt

przez iDana » Pt maja 20, 2011 4:04 pm

Hello,

I know about robots.txt but can anyone give me any more information on it?

Thanks.
Avatar użytkownika

iDana

  • Posty: 60
  • Dołączył(a): Wt paź 26, 2010 10:05 am
--
iDana

Re: robots.txt

przez iDana » Pt maja 20, 2011 4:28 pm

Thank you!:)
Avatar użytkownika

iDana

  • Posty: 60
  • Dołączył(a): Wt paź 26, 2010 10:05 am
--
iDana

Re: robots.txt

przez nigerianprince » Wt maja 24, 2011 7:53 pm

thank you as well! I was looking for robot.txt info before but the linked site is definitely a better resource than what i was referring to before
Avatar użytkownika

nigerianprince

  • Posty: 1
  • Dołączył(a): Wt maja 24, 2011 7:44 pm

Re: robots.txt

przez markomako79 » Pt sie 05, 2011 4:30 am

I added a sitemap to my wordpress blog and when I ran an page analyzer it told me that robots.txt was now present. Does this term have something to do with the sitemap, or is it totally unrelated. It would be great if someone could tell me if having robots.txt benefits my website when it comes to SEO?
Avatar użytkownika

markomako79

  • Posty: 11
  • Dołączył(a): Wt sie 02, 2011 6:08 pm
--
Creating a survival seeds website, and need some basic HTML help.

Re: robots.txt

przez HTML.net » Pt sie 05, 2011 6:48 am

Robots.txt is a file you can upload to your web site to guide search bots (Google etc.) how to index your site.

For example, if you write in a file robot.txt:

User-agent: *
Disallow: /

no page will be indexed.

You can read more at the link above: http://www.robotstxt.org

- Andreas, HTML.net
Avatar użytkownika

HTML.net
Site Admin

  • Posty: 1194
  • Dołączył(a): So wrz 11, 2010 11:24 am
--
Show some love for HTML.net on Twitter, Facebook and Google: Use the buttons on top of all pages.

Re: robots.txt

przez Preeju M S » Pt cze 09, 2017 4:22 am

Robots.txt file is a text file for restricting bots (robots, search engine crawlers ) from a website or certain pages on the website. Using a robots.txt file and with a disallow direction, we can restrict bots or search engine crawling program from websites and or from certain folders and files.
Avatar użytkownika

Preeju M S

  • Posty: 6
  • Dołączył(a): Cz cze 08, 2017 7:40 am
--
Data Entry Outsourcing Company - http://www.onlinedataentryoutsourcing.com


+ Odpowiedz

Strona 1 z 1