Most websites powered by CMS have files and folders that are not relevant for search engines and Pligg is no exception with story pages having several URL’s. The most effective and easiest way to fix this is by adding a robots.txt file to your root folder.
The robots.txt file will tell the search engine robots what pages on your blog or website should be crawled and indexed and you really don’t want them to index your admin files because there is no relevant content there so creating a simple robots.txt file can actually improve your website’s crawlability and overall SEO of your Pligg site.
12 Comments
Add this link to...
Tell a friend
Bury
The robots.txt file will tell the search engine robots what pages on your blog or website should be crawled and indexed and you really don’t want them to index your admin files because there is no relevant content there so creating a simple robots.txt file can actually improve your website’s crawlability and overall SEO of your Pligg site.
12 Comments
Add this link to...
Tell a friend
Bury
Comments
best info thx a lot http://resources832.tattoos.fdns.net
water4gas store http://vouchers340.tattoos.fdns.net/water4gas-store.htm water4gas store
mexico car run on water http://shop977.gshop.fdns.net/mexico-car-run-on-water.asp mexico car run on water
http://boats.vagina-abuse.com Hello World http://boats.vagina-abuse.com http://google.com
http://search.yahoo.com/search?p=doctorfreepharmacy.com
What is happiness?
If you think you are experiencing happiness then you really are happy.
Anyway, the opposite is equally true.
http://streamyx-promotions.ulti-mac.net/streamyx/rehderbnet-muar.html
http://www.generalissimo.org
http://www.nichepedia.org
http://www.noclicktraffic.com
http://wineageing.com
http://folkever.com
http://hottestacne.com
They say the truth will set you free. But then why is it http://www.bablz.net
that every time I tell the truth I get sent to my room?
Private Bilder und Fotos von Privaten Paaren und Girls findest du hier:
http://flibber.net/verrueckte-welt/private-bilder-und-fotos.html
certainly something to think about and consider from time to time. kratom powder I am glad you shared this story with the world.
Private Hobbyhuren: http://www.witchraven.org/ kennenlernen und ficken!