worldboxingnews.net
robots.txt
Robots Exclusion Standard data for worldboxingnews.net
Resource Scan
Scan Details
Site Domain | worldboxingnews.net |
Base Domain | worldboxingnews.net |
Scan Status | Ok |
Last Scan | 2024-11-01T12:39:53+00:00 |
Next Scan | 2024-11-08T12:39:53+00:00 |
Last Scan
Scanned | 2024-11-01T12:39:53+00:00 |
URL | https://worldboxingnews.net/robots.txt |
Domain IPs | 172.66.40.179, 172.66.43.77, 2606:4700:3108::ac42:28b3, 2606:4700:3108::ac42:2b4d |
Response IP | 172.66.43.77 |
Found | Yes |
Hash | 828273e64c6fa99a4014569448cbd201b42b197bf2676f79950eed0e51682f5c |
SimHash | 781049508d11 |
Groups
*
Rule | Path |
---|---|
Disallow | /?s=search |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.worldboxingnews.net/sitemap_index.xml |
sitemap | https://www.worldboxingnews.net/news-sitemap.xml |
sitemap | https://www.worldboxingnews.net/feed/gn |
sitemap | https://www.worldboxingnews.net/feed |