|
site traffic woes
5/26/2005 @ 8:12:15 AM | 1273 days ago | permanent link | posted in google / site
This little site has been steadily getting more hits, in theory a good thing. After checking out the logs, it seems what's gotten out of control is the spidering done by web crawlers to index site content (i.e. googlebot). Anyway, I've played around with the famous robots.txt which has improved things a bit, I opted to disallow the /img/ folder that currently holds a lot of pictures. The picture count for 2005 alone is currently over 3500. The bigger problem is that most of them are named with the format ###.jpg so indexing is pointless actually Links - http://www.searchengineworld.com/robots/robots_tutorial.htm
|
|
||||||||||||||||||||
2kewl4u.com
