After Submitting

Optimization of key words and titles and descriptions and alt text and all other things so that your site appears continually on the top.
If your site has been indexed, if indexed has it been included in the database, and if in the database what's its rank ?


Tracking the spider

A sure way of knowing if your page has been spidered or not is to look for the traces left by the spiders in the access log of your server.

The spiders are named and they are usually form the same set of machines. Here I give a in exhaustive list of search engines , their corresponding spiders and the machines from which these spiders operate :

Engine

Robot

Host

AltaVista

  • Scooter/1.0
  • Scooter/1.1 (custom)
  • Scooter/1.0
    scooter@pa.dec.com
  • ww2.altavista.digital.com
    204.123.2.67
  • add-url.altavista.digital.com
    204.123.9.76
  • scooter.pa-x.dec.com
    204.123.9.19
  • scooter.pa-x.dec.com
    204.123.9.20
  • vscooter.av.pa-x.com
    204.123.9.47

Excite

  • crawl1.atext.com
    204.62.245.166
  • crawl2.atext.com
    204.62.245.167
  • crawl4.atext.com
    204.63.245.169
  • crimpshirne.atext.com
    204.62.245.32
  • jazzhole.atext.com
    204.62.245.85

Infoseek

  • Infoseek Sidewinder/0.9
  • 204.162.98.60
  • backdraft-bbn.infoseek.com
    204.162.96.42
  • blue-bbn.infoseek.com
    204.162.96.73
  • galore-bbn.infoseek.com
    204.162.96.45
  • templeton-bbn.infoseek.com
    204.162.96.93
  • wilbur-bbn.infoseek.com
    204.162.96.92
  • cca2625a.infoseek.com
    204.162.98.90
  • cca26226.infoseek.com
    204.162.98.38

Lycos

  • 207.77.90.20
  • www.lycos.com
    207.77.90.12
  • www.lycos.com
    207.77.90.14
  • www-es.lycos.com
    207.77.90.136
  • spider4.srv.pgh.lycos.com
    207.77.90.184

Web Crawler

  • Web Crawler - AddURL/2.0
  • Web Crawler/3.0 Robot libwww/5.0a
  • tripod.webcrawler.com
    204.62.245.110
  • info.webcrawler.com
    198.3.99.63
  • wc-s11.webcrawler.com
    198.3.101.77

Check your presence

Now that you can find out if you page has been indexed or not, you can go ahead and see if your page has been included in the active index of a search engine.

GO ( Infoseek )

Go makes checking easy. Simply enter your URL in the keyword box,such as:

url:india.in
url:india.in/most
url:india.in/most/about.htm

The first method reveals every page under the root domain. If you are under someone else's domain, the second method will narrow the search to pages under your area. The last method will find a specific page. Note that the Urls don't include the www prefix. You can add this, but if these search engines have indexed your pages without them, the pages won't appear. You're covered both ways by leaving off the www prefix. Don't use the http:// prefix, either.

Hot Bot

At HotBot, to find everything from a particular web site, simply enter the domain in the keyword box, using the domain: command as shown below:

domain:india.in

After your search, you will usually be shown either one or two web pages from any site that contains the domain you entered.

In order to see all your pages, you next need to click on the "See results from this site only" link.

What happens if you need to see pages from a particular section of a web site? This is especially important for those hosted within www.nic.in domain. In these cases, you would have a web address such as:

http://www.india.in/yoursite

HotBot offers a Check URL page that can help you narrow your focus. It can be found at:

http://www.hotbot.com/help/checkurl.asp

Unfortunately, the page isn't particularly intuitive. Instead, you may find it easier to use the domain: and originurlpath: power commands. We've already seen how the domain: command works above. We can combine it with the originurlpath: command to narrow a search to a particular directory within a site. For example, this search:

domain:india.in
originurlpath:travel

works to find all pages from within this section of Search Engine Watch: http://india.in/travel/

AltaVista

At AltaVista, follow the same instructions as for HotBot, and select the "More pages from this site" option to see all your pages. Should you need to find a particular page or a section of a web site, use the url: command, which works just as at Go.

Excite

There's no easy way to do a URL check in Excite. The best method is to enter the URL without the http:// prefix, such as:

www.india.in/welcome.html

Bear in mind that any pages containing this URL will appear, with no guarantee yours will be first. Generally, your page will come near the top, if it is in the catalog. You might also try searching for the root domain, to find many pages from the same site at once. Enter your root URL, such as: www.nic.in then choose List By Web Site, which will help concentrate your pages together.

Lycos

Lycos has a Check URL service:

http://www.lycos.com/addasite.html

Unfortunately, this service really only confirms if a page has been visited by the Lycos spider. That's not the same as the page actually being present in the Lycos index. To see if your pages are really in the index, you'll need to search for them creatively.

Start off by searching for your root domain, such as:

searchenginewatch.com

Usually, some of your pages will be listed. If not, try the search again, but drop off the www prefix and any suffixes, such as .com. For example: searchenginewatch To find particular pages, or if the suggestions above fail, try searching for unique text on the page or for words in the title. Enter your page title, or several words from it. Remember, if the words are common, you may not find the page among the others that will match your search.

Web Crawler

As with Lycos, finding your actual listing can be tricky. Entering the URL may turn up anything but your site. Again, try searching for unique words.


Check your Rank

1.WebPosition Gold
http://www.webpositiongold.com/
2.TopDog Search Engine Analyzer/Submitter
http://www.topdog2000.com/
3.PositionAgent
http://www.positionagent.com/
4.ScoreCheck
http://www.scorecheck.com/
5.InterNetGain
http://www.internetgain.com
6.The Informant
http://informant.dartmouth.edu/


 

 

Search Engine Registration Home
Tips and Tricks Section
Home

1