womenscompetitions.thefa.com
robots.txt
Robots Exclusion Standard data for womenscompetitions.thefa.com
Resource Scan
Scan Details
| Site Domain | womenscompetitions.thefa.com |
| Base Domain | thefa.com |
| Scan Status | Ok |
| Last Scan | 2024-10-20T12:58:03+00:00 |
| Next Scan | 2024-11-19T12:58:03+00:00 |
Last Scan
| Scanned | 2024-10-20T12:58:03+00:00 |
| URL | https://womenscompetitions.thefa.com/robots.txt |
| Domain IPs | 104.45.30.9 |
| Response IP | 104.45.30.9 |
| Found | Yes |
| Hash | 4c91173f490033bd7fb7bdebb91a17a2afdc5dc24180a5748ab238d01d08e324 |
| SimHash | 28d91e254750 |
Groups
gsa-crawler
| Rule | Path |
|---|---|
| Disallow | /assets/css |
| Disallow | /home |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore/ |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
| Disallow | /play-football/ |
| Disallow | /play-football-near/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /assets/css |
| Disallow | /home |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore/ |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
| Disallow | /play-football/ |
| Disallow | /play-football-near/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /assets/css |
| Disallow | /home |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore/ |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
| Disallow | /play-football/ |
| Disallow | /play-football-near/ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 3 invalid lines.