Forum
Welcome, Guest
Please Login to access forum.
[SOLVED]After installing my server was too busy (1 viewing) 
Go to bottom
TOPIC: [SOLVED]After installing my server was too busy
#499
rougg
Fresh Boarder
Posts: 8
User Offline
[SOLVED]After installing my server was too busy Karma: 0  
Okay I bought the Pro.

I installed jSitemap without problems and everything was setup correctly.
I have jDefender extension from joobi.co that traces my site visits.

I noticed that after installing jSitemap.. My site visitor was my server trying to visit all the pages of my site.

It visit everywhere.. all extensions, pages and even profiles.
And it visits every seconds.. With this my server has a spike due to a lot of site request.

I have installed sitemap since Friday... and my server CPU has increased 20% (from 10-20% it becomes 40%). if i disable sitemap.. then my server will be back to normal which is kind of 10-20% usage only.

Any thoughts about this?

Does sitemap actually go to every page it can find?
 
Logged Logged  
  The administrator has disabled public write access.
#500
John Dagelmore
Admin
Posts: 3722
User Online Now
Re:After installing my server was too busy Karma: 79  
Hi Cheryl,

the most weird thing is that the sitemap is generated on demand, so when the sitemap component is not executed the realtime sitemap is not generated at all and no resources are involved.

During sitemap generation if you have a site with thosands of links it's normal that some CPU is used, generating a bunch of links for a sitemap can be a quite expensive task.

If you tracked visits to your server by your server itself( i think i've understood correctly ) the only case should be if you have enabled the images sitemap. In this case a crawler searches images in your pages to add to sitemap. All other types of sitemaps doesn't involve any page visit, because links are generated directly from database queries.

You can however do a quick test enabling sitemap cache. This will avoid a new sitemap generation every time the component links are executed, and reduce server CPU.

So if bots fetch often the sitemap a cached copy will be used and CPU saved.

Best regards

John
 
Logged Logged  
  The administrator has disabled public write access.
#501
rougg
Fresh Boarder
Posts: 8
User Offline
Re:After installing my server was too busy Karma: 0  
I have a 3 gig website. ;(

Okay this is what I did.. Let me know if I miss a setup...
1. Install jSitemap
2. setup few data sources and disable few
3. created a menu for sitemap
4. exported the sitemap and uploaded it to google and bing

Do I need to upload something in my server or add a line of code in my htaccess?
 
Logged Logged  
  The administrator has disabled public write access.
#502
John Dagelmore
Admin
Posts: 3722
User Online Now
Re:After installing my server was too busy Karma: 79  
Well, if you exported a static file for sitemap, placed it at server root and uploaded to bing such as for example: http://www.yoursite.com/sitemap.xml

This means that the JSitemap component is no more executed after the exporting time, the only time it's executed again to generate a fresh sitemap is when you visit the sitemap link in menu. Of course using cache saves new sitemap generation.
 
Logged Logged  
  The administrator has disabled public write access.
#509
rougg
Fresh Boarder
Posts: 8
User Offline
Re:After installing my server was too busy Karma: 0  
Okay I understand. I will download the link for html sitemap to my server root and to google/bing.
I will see if my server resources will go down.

Thank you for your fast help!
 
Logged Logged  
  The administrator has disabled public write access.
#513
John Dagelmore
Admin
Posts: 3722
User Online Now
Re:After installing my server was too busy Karma: 79  
Be careful to use always XML format for Google/Bing.

Normally links to generate sitemaps are directly submitted.

John
 
Logged Logged  
  The administrator has disabled public write access.
Go to top