Saturday, 30 June 2007

Free services

AltaVista was also one of the numerous websites which promised "free email for life", only to subsequently reverse this policy by charging a subscription fee for its email services.

Source: http://en.wikipedia.org/wiki/AltaVista

Friday, 29 June 2007

The Inktomi name

"The company's name, pronounced "INK-tuh-me," is derived from a Lakota Indian legend about a trickster spider character. Iktomi is known for his ability to defeat larger adversaries through wit and cunning." [2]

Source: http://en.wikipedia.org/wiki/Inktomi

Thursday, 28 June 2007

Trivia

In 1999, Infoseek engineer Li Yanhong moved to Beijing, China and co-founded the search engine Baidu.

Source: http://en.wikipedia.org/wiki/Infoseek

Wednesday, 27 June 2007

Politeness policy

Crawlers can retrieve data much quicker and in greater depth than human searchers, so they can have a crippling impact on the performance of a site. Needless to say if a single crawler is performing multiple requests per second and/or downloading large files, a server would have a hard time keeping up with requests from multiple crawlers.

Source: http://en.wikipedia.org/wiki/Web_crawler

Saturday, 23 June 2007

Crawling policies

There are three important characteristics of the Web that generate a scenario in which Web crawling is very difficult:

Source: http://en.wikipedia.org/wiki/Web_crawler

Vertical Search Engines

Vertical search engines or specialized search engines are search engines which specialize in specific content categories or that search within a specific medium. Popular search engines, such as Google or Yahoo!, are very effective when the user searches for web sites, web pages, or general information. Vertical search engines enable the user to find specific types of listings, thus making the search more customized to the user's needs.

Source: http://en.wikipedia.org/wiki/Searchengine

Friday, 22 June 2007

Yahoo! Search

The two founders of Yahoo!, David Filo and Jerry Yang, Ph.D. candidates in Electrical Engineering at Stanford University, started their guide in a campus trailer in February 1994 as a way to keep track of their personal interests on the Internet. Before long they were spending more time on their home-brewed lists of favourite links than on their doctoral dissertations. Eventually, Jerry and David's lists became too long and unwieldy, and they broke them out into categories. When the categories became too full, they developed subcategories ... and the core concept behind Yahoo! was born. In 2002, Yahoo! acquired Inktomi and in 2003, Yahoo! acquired Overture, which owned AlltheWeb and AltaVista. Despite owning its own search engine, Yahoo! initially kept using Google to provide its users with search results on its main website Yahoo.com. However, in 2004, Yahoo! launched its own search engine based on the combined technologies of its acquisitions and providing a service that gave pre-eminence to the Web search engine over the directory.

Source: http://en.wikipedia.org/wiki/Searchengine