Description

  • placed in root directory of website
  • tells web crawlers what is off-limits