Too Long; Didn't Read
Mozilla (stylized as moz://a) is a free software community founded in 1998 by members of Netscape. It decides whether crawlers are permitted or forbidden access to the web site. For example, the site admin can forbid crawlers to visit a certain folder (and all the files therein contained) or to crawl a specific file, usually to prevent those files being indexed by other search engines. It is a file which is usually placed in the root of any website and decides if crawlers should be allowed access.
Share Your Thoughts