Search engine spiders are programs on the Internet that search through the content on the web by using a variety of strategy algorithms. Spiders are often known as a “bot” or a “wizard” since they seem to magically check through huge indexed databases.
When you are building your ecommerce website you’ll want to take advantage of these active search engines as they conduct searches for a specific url which users request of them.
There are several efficient spider systems that you’ll want to take advantage of if you want your website to carry any weight in the search engine index. The most popular spiders include:
- Architext. This spider is owned by Excite and uses tags for its indexing as well as a Boolean algorithm to bring you the most basic of topic information.
- GoogleBot. Google is constantly updated so that it contains all the important indexers.
- Scooter. This spider is owned by Altavista and uses the Boolean strategy to index information.
- Sidewinder. Infoseek uses a timestamp to ensure that relevant indexes are placed in major order.
- Northern Lights Gulliver. Northern Light is well known for its stability and precision in bringing you up to date information.
- T-Rex. This spider is owned by Lycos and is one of the major searching bots on the Internet.
- Excites Architext. This search engine is owned by Webcrawler.
- Yahoo. Yahoo continues to lead the way with searching techniques that have a relevancy to the input provided by SEO submissions. Yahoo is one of the most popular spiders.
- Teoma. This spider is frequently updated so that each topic is in precise order.
- LookSmart. This spider uses researching techniques to index all the data that it collects.
// posted by BasicMichelle on 2/08/2006 06:16:00 AM / Permanent Link 
| Post Archives | Post a Comment | Subscribe to Blog 
