thefa.com
robots.txt
Robots Exclusion Standard data for thefa.com
Resource Scan
Scan Details
| Site Domain | thefa.com |
| Base Domain | thefa.com |
| Scan Status | Ok |
| Last Scan | 2024-10-27T03:13:23+00:00 |
| Next Scan | 2024-11-26T03:13:23+00:00 |
Last Scan
| Scanned | 2024-10-27T03:13:23+00:00 |
| URL | https://www.thefa.com/robots.txt |
| Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
| Response IP | 13.107.246.69 |
| Found | Yes |
| Hash | 2e0e8287a2c18914760dc24b786fc8cf668b310c079a736c68edb25df110cec8 |
| SimHash | 88d517254f50 |
Groups
gsa-crawler
| Rule | Path |
|---|---|
| Disallow | /assets/css |
| Disallow | /home |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore/ |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
| Disallow | /play-football/ |
| Disallow | /play-football-near/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /assets/css |
| Disallow | /home |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore/ |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
| Disallow | /play-football/ |
| Disallow | /play-football-near/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /assets/css |
| Disallow | /home |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore/ |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
| Disallow | /play-football/ |
| Disallow | /play-football-near/ |
Warnings
- 3 invalid lines.