[Solved] Robots.txt not correct Syntax
Feb 3, 2012 8:06 pm by baracuda
Feb 3, 2012 8:06 pm by baracuda
Hello,
Google says that i use a wrong syntax in robots.txt:
http://www.ng-bikes.ch/tl/
This line doesn't follow a correct syntax. The correct syntax is: <field>:<optionalspace><value><optionalspace> , where "field" can be "User-agent" or "Disallow". Please refer to Robots Exclusion Standard page for more informations.
i used this checker: http://tool.motoricerca.info/robots-checker.phtml
and google webmaster tools: Syntax wurde nicht verstanden (didn't unterstand the syntax
so, why is this syntax not correct, why use gtranslate a wrong syntax and works it nevertheless?
i have in my htaccess a rewrite rule, that correct the url to www. ... so i have no duplicated content.
Re: Robots.txt not correct Syntax
Feb 3, 2012 9:32 pm by Yana
Feb 3, 2012 9:32 pm by Yana
Hi,
Please remove this lines from robots.txt
http://www.ng-bikes.ch/en/
http://www.ng-bikes.ch/af/
http://www.ng-bikes.ch/sq/
http://www.ng-bikes.ch/ar/
........................
Add this line
Sitemap: http://www.ng-bikes.ch/sitemap.txt
You can have more than one sitemap.
Create sitemap.txt in the root folder with the content like this
http://www.ng-bikes.ch/en/
http://www.ng-bikes.ch/af/
http://www.ng-bikes.ch/sq/
Re: Robots.txt not correct Syntax
Feb 3, 2012 9:56 pm by baracuda
Feb 3, 2012 9:56 pm by baracuda
ah fuck, i'm sorry, it's my misstake, to stupid to read the introcution right.
SIMILAR TOPICS
Some of the translations on my site are not correct | Nov 13, 2017 9:33 am | Replies: 5 | Post by: straightpoint |
[SOLVED]double dropdown | Oct 26, 2017 8:26 am | Replies: 3 | Post by: danielesantosubito |
[SOLVED] NOT WORKING, HELP PLEASE! | Feb 12, 2017 4:53 pm | Replies: 5 | Post by: TSM |
Need help <SOLVED> | Feb 6, 2017 1:48 pm | Replies: 5 | Post by: blaxx |
[solved] edit translations problem | Dec 15, 2011 10:05 pm | Replies: 19 | Post by: slweb2 |