[Solved] Robots.txt not correct Syntax

Popular automatic website translation tool

[Solved] Robots.txt not correct Syntax

Postby baracuda » Sat Feb 04, 2012 12:06 am

Hello,

Google says that i use a wrong syntax in robots.txt:
http://www.ng-bikes.ch/tl/
This line doesn't follow a correct syntax. The correct syntax is: <field>:<optionalspace><value><optionalspace> , where "field" can be "User-agent" or "Disallow". Please refer to Robots Exclusion Standard page for more informations.

i used this checker: http://tool.motoricerca.info/robots-checker.phtml
and google webmaster tools: Syntax wurde nicht verstanden (didn't unterstand the syntax

so, why is this syntax not correct, why use gtranslate a wrong syntax and works it nevertheless?

i have in my htaccess a rewrite rule, that correct the url to www. ... so i have no duplicated content.
baracuda
 
Posts: 6
Joined: Sat Jan 28, 2012 2:03 am

Re: Robots.txt not correct Syntax

Postby Yana » Sat Feb 04, 2012 1:32 am

Hi,

Please remove this lines from robots.txt
http://www.ng-bikes.ch/en/
http://www.ng-bikes.ch/af/
http://www.ng-bikes.ch/sq/
http://www.ng-bikes.ch/ar/
........................

Add this line
Sitemap: http://www.ng-bikes.ch/sitemap.txt


You can have more than one sitemap.
Create sitemap.txt in the root folder with the content like this

http://www.ng-bikes.ch/en/
http://www.ng-bikes.ch/af/
http://www.ng-bikes.ch/sq/
Regards,

Yana Ghahramanyan - GTranslate Team

Please leave your feedback on your CMS plugin directory. It is very important for us!
Google Translate Joomla
Google Translate WordPress
Google Translate Drupal
Yana
 
Posts: 4129
Joined: Thu Jan 12, 2012 6:21 pm

Re: Robots.txt not correct Syntax

Postby baracuda » Sat Feb 04, 2012 1:56 am

ah fuck, i'm sorry, it's my misstake, to stupid to read the introcution right.
baracuda
 
Posts: 6
Joined: Sat Jan 28, 2012 2:03 am


  • Related Topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: No registered users and 0 guests

2GLux