![]() |
|
| >> Web Hosting Geeks // Web Hosting Articles // SEO - Search Engine Optimization |
|
|
Abandoned by Google! Googlebot, Wherefore Art Thou Googlebot?
As a search engine optimization specialist I often optimize existing web pages for small business clients, upload them to the site and see pages re-indexed by Google within a week. This only happens with existing business sites that have been online for a few years. Google seems to be updating their index as often as every other week at this point and older established sites that are already indexed seem to be re- crawled on that twice a month schedule on a fairly routine basis. Two clients that hired me for recent work saw their rankings shoot to the top for a newly targeted search phrase in a weekend when I did optimization on a Thursday and they were ranked instantly by Saturday. Now keep in mind that this doesn't happen for everyone, only those that have been online for some period and already have significant content that simply needs tweaking and proper title and metatag information added. They usually have relatively good existing PageRank and do well for other RELEVANT search phrases already. I offer that warning only to avoid instilling false hopes in anyone hoping to achieve the same instant ranking boost overnight. Those clients that do succeed in this way are often thrilled with the results accomplished in such short order. I'd love to be able to offer that type of ranking boosts to everyone, but some are more equal than others when it comes to easy, inexpensive SEO tune-ups that rev up your rankings overnight. Your mileage may vary. WHY DO NEW SITES SUFFER? What is going on with newer sites that don't get crawled for months? I've got a client, a newer attorney directory that offers tons of great information in the form of articles on specific areas of law, links to incredibly valuable and relevant legal sites and over 600,000 attorneys listed by practice area and state. Yet the site has not been re-crawled by Google for over 3 months! Now this would not be such a big issue for many sites, but this site is relatively new and we've optimized all the titles, tags & page text, created a complete site map and placed links to all these resources on the front page. I know that the site is not being crawled because Google's cached copy of the front page shows it before we did the work four months ago, without the new links and without title tags. We've submitted the site by hand, (manually) once a month for three months via the Google Add URL page. http://www.google.com/addurl.html When the hand submission failed to get it re-indexed for four months, we submitted the sitemap page, which has not been crawled at all. Google shows only ONE page on this site, when in fact it has thousands of pages, a sitemap and dozens static pages! Part of the problem is that this site must be dynamic, since a database of over 632,000 attorneys must be accessed, retrieved and served for any of those law firms searched for to be returned to the site visitor. Google warns owners of dynamic sites that Googlebot may not crawl dynamically generated pages with "?"" question marks in the URL. This is to avoid crashing the server with too many concurrent page requests from Google's spider. http://www.google.com/webmasters/2.html#A1 The solution to this dynamic URL problem has been discussed widely in search engine forums and solutions have been bandied about including software provided by SEO's, URL re-write techniques for dynamic pages on APACHE servers http://www.alistapart.com/articles/urls/ and PHP pages http://www.stargeek.com/php-seo.php to generate search engine friendly URL's. Others recommend simply adding static HTML sitemap pages as alternatives for the search engine spiders. In this instance the client's developer simply said "I can't do that (PHP solution) on this server". So we resorted to putting up the static HTML sitemap pages with hard-coded URLS to the main 54 pages of the site at http://lawfirm411.com/Law-Firm-411-sitemap.html This should get at least those fifty pages crawled by Googlebot, but Googles' spider appears not to be crawling this site at all. How do we know this? See for yourself by using the following query in the search box at Google: allinurl:www.lawfirm411.com where the result page shows ONE page in the results. If you try that query on your own site (replace your own domain name for lawfirm411.com), you'll see the results lists ALL your pages. The site home page was crawled by Google four months ago, when they took their "Cached Snapshot" of the page. You can see this by visiting the Google cached page here: http://66.102.7.104/search?sourceid=navclient&;ie=UTF-8&q=cache:www.lawfirm411.com where the date of this snapshot is "Apr 20, 2004 07:42:19 GMT" and they haven't been back since. The page in that snapshot has none of the newly added links, an outdated title tag, and old content. This problem is not unique to this site. One client we worked with two years ago had a dynamically generated, framed site! Those two site structures have always given search engines trouble. Their site was not crawled at all and only the front page showed up. Our solution was to create a second domain (owned by the client), which had static HTML pages that precisely mirrored the content of the client's framed, dynamically generated site. Guess what happened after Googlebot crawled the static site? Google indexed the framed site in full and then banned the static site from the index! Not an approach we advocate, but the one that worked for this client. We're still searching for ways to get Googlebot back to LawFirm411.com before creating that new static site, but decided to share this odd experience with the SEO community before going to any extremes. Google provides over 70% of most search engine referred traffic to ALL of our clients and we realized we can't site idly by and see a major client languish because Googlebot didn't like what it found at the client site on the first visit four months ago. This issue dogs newer sites in other places as well. The Open Directory Project has also become notoriously slow in adding new sites to the directory and in this case, has not picked up this site even after 6 regular monthly submissions. The web playing field may have begun tilting toward older, established sites and away from new ones. ------------------------------------------------------------ Mike Banks Valentine is the SEO for http://www.lawfirm411.com Contact him at http://www.seoptimism.com/SEO_Contact.htm Improve Your Small Business Online at our Ecommerce Tutorial http://website101.com/Free-Tutorials/index.html ------------------------------------------------------------
MORE RESOURCES:
SEO - Google News |
RELATED ARTICLES
How You Can Easily Compile A Gigantic Keyword List It doesn't matter what kind of marketing you are involved in.Having the most keywords for your market or niche is a surefire way to win over your competition, and that's a fact!The most important place to have thousands of keywords is in your pay-per-click campaigns, as you want to hit as broad an audience as possible, within your market or niche. An Ethical Alternative to Doorway Pages Definition: A doorway page is content created specifically for the purpose of garnering high placements in the search engines.Issue: Google makes the following specific recommendation: Avoid "doorway" pages created just for search engines or other "cookie cutter" approaches such as affiliate programs with little or no original content (http://www. An SEO Checklist Search engine optimization is on every webmaster's mind these days. Achieving a favorable ranking for the right keywords can mean a steady stream of targeted traffic to your site, and all for free - that's hard to beat. How to Avoid Being Dropped by the Search Engines For websites, one of the most important things in their existence is their ranking with the search engines. The reason why this is so important is because when websites are ranked high by the search engines, they get flooded with free, targeted web traffic from visitors who are looking for information or products. Submitting Your Site To The Open Web Directory: Some Dos And Don'ts One of the most important steps in any site's publicity campaign is the submission to the Open Web Directory (http://www.dmoz. Youve Got The Power, Why Arent You Promoting It? Like all things, theft is theft, misery loves company, negative people are everywhere, business is sometimes bad, things go up and others go down.If those are all true then knowledge is power right? Wrong, knowledge is only power if applied. 10 Quick Ways To Kick-Start Your Profit Pulling Keywords First, you must realize that targeting the right keywords or phrases is the 'key' to making any kind of profit from your site. Choosing the 'right' keywords (the exact keyword or phrase surfers type into the search engines to find your site or product) can make or break your online venture. Five and a Half Ways to Amp Up Your Search Engine Optimization Statistics show that 85% of pages visited on the Internet come from people who have gotten there from a search engine. Statistically, people look first at the top of the first page of the regular search results, then the bottom, and then they go to the sponsored listings. Why You Need a SEO Maintenance Plan A search engine optimization maintenance service plan will ensure that your site will continue to increase in its rankings, attract more visitors and make more sales. It's not enough to simply design your web site, have it optimized for the search engines and expect it to continually rank well. Should You Buy Text Links? You can rank number one (Or at least in the top ten) for just about any search phrase by just buying text link ads, even if the web site isn't related to the search phrase in anyway, it can still rank in the top ten of the search results. Some web site owners see this as the only true way to the top ten. How Directories Help Search Engines At the beginning of the web era, users would go to directories to find sites relevant to their interests. In fact, Yahoo!, the web's number one destination, started as a directory. How to Increase Alexa Ranking of Your Website Alexa toolbar also useful to Browse expired websites database. Many times when we visit any website we got error message that website is not available. Search Engine Optimization :: The Basics and Why Websites Need It We all know that the most targeted traffic we can get for our websites is from search engines. If you have a little patience and time to set websites the right way you can have a great source of excellent traffic and, best of all, you get it for free. How Search Engines Connect Sellers and Buyers Maggie knows how to find what she wants. She lets her fingers do the walking - not in the Yellow Pages, but at Google. Beyond Search Engines Some webmasters report that search engines account for 75% or more of their total website traffic. However, it's important not to become too dependent on search engines for new business. 10 Minutes to Your Google Sitemap Google's calling your name.. SEO Expert Guide - Page Optimization (part 5/10) In parts 1 - 4 you learnt how to develop your online business proposition, generate a list of key words and optimize at a site level. You were also introduced to our mythical Doug (who sells antique doors, door handles, knockers, door bells or pulls and fitting services) in Windsor in the UK. Get Better Search Engine Rankings with RSS RSS is the latest craze in online publishing. But what exactly is RSS?RSS or Rich Site Syndication is a file format similar to XML, and is used by publishers to make their content available to others in a format that can be universally understood. 7 Steps to Highly Relevant, Search Engine Friendly, and People Useful Web Site Content The task is to build a Content Rich Search Friendly and People Friendly Web Site Quickly. These 7 Steps will show you how with about 10 Hours work you can build over 50 pages of rich, Search Engine relevant content for your web SiteStep 1 - What is Your Web Site's Main ThemeThis is a Fairly easy step. Developing A List Of Keywords For Marketing Keywords aren't just some words that allow search engines, like Google, to find your web site. They are also key elements for creating attractive language to use in your marketing or advertising material. |
|
|
|
|
| © 2004 - 2008 "Web Hosting Geeks" | Web Hosting Reviews | Customer Reviews | RealMetrics Reviews | Hosting Articles | Directory | Partners | Contacts Over 7000 articles: web hosting, web development, domain names, ecommerce, web design, site promotion, ppc advertising, seo, site promotion and many others. Web hosting reviews, ratings and awards are not based on any incentives or commissions. Names and trademarks are the properties of their respective owners. A direct link to Web Hosting Geeks (http://webhostinggeeks.com) must be provided in order to use any of the above information. Contact us for more info. Partners: Hosts by speed, Cheap Website Hosting, Free Website Hosting, Cheap Web Hosting, Top 10 Web Hosts, Top 10 Web Hosting Deals, Best Website Hosting, Free Web Hosting, Free Web Hosting, Dedicated Server Hosting, Adult Web Hosting, Web Hosting Discussions, Dedicated Server Reviews, Best Web Hosting, Web Hosting Discounts, HostProfessor.com, rsuog, halyava, PHP Website Hosting Services, Web Hosting Reviews, Hosting Uptime, Best Web Hosting Reviews, Cheap Webhosting, Web Hosting, Flash Templates, CMS Templates, Web Hosting Reviews, Website Hosting Reviews, Web Hosting Providers, Best Web Hosting, Top Web Hosting, RSUOG Web Hosting |