| Top Web Hosting Provider of The Month: |
 |
| Visit Bluehost.com | Read Bluehost Review |
|
|
| >> Web Hosting Geeks // Web Hosting Articles // SEO - Search Engine Optimization |
|
|
 |
The Role of the Robots.txt File to Improve Site Ranking!
Not many web master take the time to use a robots.txt file for their website. For search engine spiders that use the robots.txt to see what directories to search through, the robots.txt file can be very helpful in keeping the spiders indexing your actual pages and not other information, such as looking through your stats! The robots.txt file is useful in keeping your spiders from accessing parts folders and files in your hosting directory that are totally unrelated to your actual web site content. You can choose to have the spiders kept out of areas that contain programming that search engines cannot parse properly, and to keep them out of the web stats portion of your site. Many search engines cannot view dynamically generated content properly, mainly created by programming languages, such as PHP or ASP. If you have an online store programmed in your hosting account, and it is in a seperate directory, you would be wise to block out the spiders from this directory so it only finds relevant information. The robots.txt file should be placed in the directory where your main files for your hosting are located. So you would be advised to create a blank text file, and save it as robots.txt, and then upload it to your web hosting to the same directory your index.htm file is located. Here is examples of the use of the robots.txt file: To block out a directory in a robots.txt file, such as a subdirectory for your online store called /store/ you would do the following: Disallow: /store/ Another example to block out your stats directory: Disallow: /stats/ You may also want to disallow individual files that you do not want searched by the search engines. For example you dont want search.php to be parsed by the Search Engines. To do this you type in the following on its own line: Disallow: /search.php Following the rules outlined and creating the robots.txt file, you will keep search engine spiders out of unwanted files and directories, and letting them go through the important files to see what your web site is all about! Michael Kralj is owner of Emenki Web Solutions and Domains at Retail. Emenki Web Solutions are web site designers and programmers based in Hamilton, Ontario, providing businesses with an informative and strategic approach to establishing an online presence on the web. Please visit Emenki Web Solutions & Web Design in Hamilton, Ontario on the web http://www.emenki.com Please visit Domains at Retail - Cheap Domain Name Registration on the web: http://www.domainsatretail.com
MORE RESOURCES:
SEO - Google News |
|
|
|
RELATED ARTICLES
Do You Submit Your Website To All The Search Engines? There is really only one search engine to worry about submitting too and that is Google and you should only submit one page your main once and maybe a sitemap a week later but never more than once a week. If you have a link coming to your new site from a site that is currently listed in Google then Google will find you quicker. The Secret To Getting Indexed In Yahoo Getting indexed in Yahoo has become very difficult in the last few months. The indexing robot, Yahoo!Slurp, has become erratic. 13 Tips For Good Search Engine Placements When used properly in combination with other basic search engine tactics, these tips can help to dramatically improve your placement with the search engines and increase the traffic to your web site.1. Forget SEO - It's All About Conversion! Which SEO hat do you wear? Is it white or black? Or perhaps it's a subtle shade of gray. Well, wherever you are on this spectrum, if you are like 99% of the SEO-fixated webmasters out there, you are doing all you can to get visitors to your site. Google has an Achilles Heal - Will Their Competitors Notice? Even though Google Revenues continue to soar, the hidden problem that may stifle growth and may even allow Yahoo or MSN to overtake the paid search market in the future lies in two critical phrases: Customer Support, and Customer TrainingApproximately 40% of the small businesses we have surveyed have tried Adwords in the past and failed, and some of them have tried multiple times. In some markets the percentage is closer to 60%. Google Is Taking Descriptions From Alexa! In a recent study looking at the "descriptions" of website search engine listings, we have noticed that your main SERP listing is being manipulated by Alexa.com. A Play In The Sandbox Is Necessary There has been a good deal written about the Google 'sandbox' effect, as it's known. It has been taking up a lot of forum and article space over the last few months. Crash Course in Getting a #1 Google Ranking First, here's the rundown of some of the terminology I'm going to use -Inbound Links - Links coming into your site Outbound Links - Links leaving your site Cross Links - Links that you have "traded" with another site (ie, they've got a link from their site to your and you've got a link from your site to theirs) PR (Page Ranking) - Google's measure of how "important" your site isSEO Is Not DeadOk, now lets talk about what you really want to hear - how to get those coveted 1-10 ranks for your keywords. Remember this - SEO is not dead. The Purpose of PageRank? I am sure the first thought provoking question that popped into your head would be: what exactly is PageRank? Well PageRank can be summed up as how vital Google considers a particular webpage. Pagerank is a value from 0-10, zero being the least significant and ten of which few obtain being the most note-worthy. Playing By Googles Rules As the undisputable leader in search engines, Google places a very high importance on the quality and relevancy of its search results, especially now that the company is public. The know that in order to keep the shareholders and users of the engine happy, the quality of returned results are extremely important. How To Measure Search Engine Marketing ROI According to the Search Engine Marketing Professional Organization (SEMPO), advertisers spent $4 billion in 2004 on search marketing programs and are expected to spend 39% more than that this year.Search engine marketing appears to be a great way to advertise but is it right for you and your business? If you are not already employing search engine marketing(SEM) for you business is there a way to forecast the return should you decide to invest in it? Is there a way to measure the results you are getting if you have already invested in SEM?The answer is mostly yes. Using Google Thanks to a unique algorithm that produces most relevant results to any given query, Google has become, indisputably, the best search engine on the Internet. On the last count, Google has indexed over 4 billion pages and tackles around 200 million searches a day! A cluster of 100 thousand servers are used to store, crunch and spew out the query results with lightning speed that you are so accustomed to see. The Power of Topic Specific Search What are Topical Search Engines?Simply put, topical search engines are search engines focused on a specific industry, sector or topic.While many marketers are scrambling for links, any links, an area that is often overlooked is topic-specific search engines. Make The Search Engines Love Your Site Most webmasters have no idea on how to make a search engine friendly web site. If you are one of them this will all change by following these steps below. Google Page Rank Is Dead - Part III HELP! My PR page rank is grey, call the development doctor. As the world of Google is turning a mile a minute these days, some really big changes are happening. You Have More Web Sites Than You Think You Have: The Importance of Deep Submission If I ask you how many web sites do you have? You may say "One, yes it is www.mycompany. The Best 7 Steps To Get A Top Google Ranking Guaranteed Google returns more search results then any other search engine. Clearly if you can get a Top Ranking in Google you will drive highly targeted traffic to your web page. Google Ban - How Not To Get Banned By Google! Given that Google now provides over 75% of all Internet search traffic, the last possible thing any site owner would want is to be banned from the Google index!With countless search engine marketing techniques being employed these days, and contrasting advice available all over the web, it is well worth ensuring that you do not 'over optimise' your site or use any techniques which will result in Google penalising your site.Although the main rule would be to create a site which caters for your audience, provides quality content and contains meta information which is faithful to your site content, you should always optimise your site code to aid in your search ranking efforts, but this should be done in moderation, and in line with the following tips. Increase Web Site Sales with a SEO Proposal - Part 1 You can easily get confused by all the search engine optimization companies and SEO experts that offer SEO services. It's hard to know who to trust or what should be included in a SEO proposal. What Is Search Engine Optimization And Why Do I Need It? Purchasing web design service is confusing with all of the different buzz words floating around. In an earlier article I discussed the differences between custom web design and web design based on templates.
|
|
|
|
|
| © 2004 - 2008 "Web Hosting Geeks" | Web Hosting Reviews | Customer Reviews | RealMetrics Reviews | Hosting Articles | Directory | Partners | Contacts Over 7000 articles: web hosting, web development, domain names, ecommerce, web design, site promotion, ppc advertising, seo, site promotion and many others. Web hosting reviews, ratings and awards are not based on any incentives or commissions. Names and trademarks are the properties of their respective owners. A direct link to Web Hosting Geeks (http://webhostinggeeks.com) must be provided in order to use any of the above information. Contact us for more info. Partners: Hosts by speed, Cheap Website Hosting, Free Website Hosting, Cheap Web Hosting, Top 10 Web Hosts, Top 10 Web Hosting Deals, Best Website Hosting, Free Web Hosting, Free Web Hosting, Dedicated Server Hosting, Adult Web Hosting, Web Hosting Discussions, Dedicated Server Reviews, Best Web Hosting, Web Hosting Discounts, HostProfessor.com, rsuog, halyava, PHP Website Hosting Services, Web Hosting Reviews, Hosting Uptime, Best Web Hosting Reviews, Cheap Webhosting, Web Hosting, Flash Templates, CMS Templates, Web Hosting Reviews, Website Hosting Reviews, Web Hosting Providers, Best Web Hosting, Top Web Hosting, RSUOG Web Hosting |
