User-agent:* Disallow: /_db_backups/ Disallow: /css/ Disallow: /docs/ Disallow: /login/ Disallow: /provider/ Disallow: /providers/ Disallow: /read_dir/ Disallow: /stats/