| |
BitTorrent Search Engine
|
|
Finding information in the world wide web is a challenging task due to an enormous number
of unstructured documents. Finding the information that you are really looking for is
significant harder. Assume that the world wide web consists of eight billion web sites where
each web site has an average size of 30K. Then the total size would be approximately 220TB.
With btbot we are running a specialized search engine that looks for links which point to BitTorrent files.
Only a small fraction of the web sites out there contains such links so that we can
profit from crawling strategies which visits relevant sites only to reduce bandwidth
usage and to visit relevant sites more often than other sites.
Therefore, we have founded the department BTlabs that is responsible for the development of
efficient algorithms on the following research areas:
 | Information retrieval |
 | Graph algorithms |
 | Knowledge management |
| Machine learning |
| Clustering |
| Distributed file systems |
| Artificial intelligence |
| Text processing |
| |
All algorithms must be able to operate on very large data sets of several hundreds of gigabytes. Graph algorithms
should scale with graphs with hundred of millions of nodes and edges as well.
Therefore, all constant factors in the complexity of algorithms have a great impact on performance!
To contact the labs of btbot use this email:
|
|
