J!Extensions Store™
Forum
Welcome, Guest
Please Login to access forum.
- Joomla! Extensions Store
Re:Sitemap contains urls which are blocked by robots.txt. (1 viewing) 
Go to bottom
TOPIC: Re:Sitemap contains urls which are blocked by robots.txt.
#1675
Gary Abel
Fresh Boarder
Posts: 5
User Offline
Re:Sitemap contains urls which are blocked by robots.txt. Karma: 0  
John Dagelmore wrote:
QUOTE:
Hello Gary,

you need to remove the line: Disallow: /modules/
from the robots.txt in order to allow indexing of images such as:
https://www.mywebsite.com/modules/mod_weather_gk4/icons/default/32/chance_of_storm.png



I was thinking that the better solution rather than allowing the bot access would be if the module url was not submitted by the sitemap as it serves no purpose in being indexed by a search engine. Is this possible?

Thanks for your speedy help.
 
Logged Logged  
  The administrator has disabled public write access.
Go to top