A web crawler (also known as a web spier or web robot or - especially in the FOAF community - web scutter) is a program or automated script which browses the World Wide Web in a methodical, automated manner. Other less frequently used names for web crawlers are ants, automatic indexers, bots, and worms.