Url Server

Some articles on url, url server, urls:

Scutter - Examples
... was done for full-text indexing and also for URL extraction ... There is a URL server that sends lists of URLs to be fetched by several crawling processes ... During parsing, the URLs found were passed to a URL server that checked if the URL have been previously seen ...