To fix errors of website

Must be defined fix bugs (defects) of the site
1. To create a file Robots.txt and your site map in XML and HTLM formats. A link to your site map in XML format to prescribe in Robots.txt,
2. To close from indexing junk pages