wrestling.pt
robots.txt
Robots Exclusion Standard data for wrestling.pt
Resource Scan
Scan Details
Site Domain | wrestling.pt |
Base Domain | wrestling.pt |
Scan Status | Ok |
Last Scan | 2024-05-19T18:01:53+00:00 |
Next Scan | 2024-05-26T18:01:53+00:00 |
Last Scan
Scanned | 2024-05-19T18:01:53+00:00 |
URL | https://wrestling.pt/robots.txt |
Domain IPs | 185.32.189.93 |
Response IP | 185.32.189.93 |
Found | Yes |
Hash | 9c01adb4821234c0a036fd6f2e91e0afb0d5e8f54580d9e03b3533e979e04b6b |
SimHash | 6a00487a4613 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /images/ |
*
Rule | Path |
---|---|
Disallow | /trackback/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /xmlrpc.php |
Disallow | /*?replytocom |
Other Records
Field | Value |
---|---|
sitemap | https://wrestling.pt/sitemap_index.xml |
sitemap | https://www.wrestling.pt/sitemap_index.xml |