Hi John,

Thanks for the quick reply. I did try using pre caching but that didn't help. I think I may be doing something wrong or have set this up wrong. Still 500 errors.

Thanks for the info on Google. That makes sens that they show 5600+ articles but only 500 indexed. I guess they are looking at only the articles submitted in the last year or so. We generate an average of 10 new articles a week. I did reread the documentation and have a better understanding on what Google is indexing and how.

I have placed the sitemap_xml.xml(that is the name the extension generated) and added it also to google Webmasters.

Cheers!

John Dagelmore wrote:

QUOTE:
Hi,

if you have a large sitemap and server timeout occurr, you should consider to use the AJAX precaching generation for the sitemap.
Generating the sitemap using AJAX and incremental steps will avoid server timeouts, this makes possible generate sitemaps also with 100000 links.

Remember that you need to handle XML sitemap not HTML.

As another strategy you could also export a static big sitemap positioning at server root as sitemap.xml and use the dynamic sitemap generated in realtime only for recent items.

Don't rely on the links reported as indexed in GWT. If your site is not new it reports only the difference of links added using sitemaps. Looking in the pdf component documentation is explained how to check the number of real links added to Google index using Google search.

Hope this helps.

Best regards

John Dagelmore