thestarnewsnetwork.com
robots.txt

Robots Exclusion Standard data for thestarnewsnetwork.com

Resource Scan

Scan Details

Site Domain thestarnewsnetwork.com
Base Domain thestarnewsnetwork.com
Scan Status Ok
Last Scan2024-11-12T13:59:48+00:00
Next Scan 2024-11-19T13:59:48+00:00

Last Scan

Scanned2024-11-12T13:59:48+00:00
URL https://thestarnewsnetwork.com/robots.txt
Domain IPs 104.21.95.66, 172.67.143.122, 2606:4700:3031::ac43:8f7a, 2606:4700:3037::6815:5f42
Response IP 104.21.95.66
Found Yes
Hash 1fe3e0e739461262a16a6ec24068f602adffe253d0a01d8050bcc6fc919940b6
SimHash e54291026fe6

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin

Other Records

Field Value
sitemap https://thestarnewsnetwork.com/http://thestarnewsnetwork.com/sitemap_index.xml

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Mon, 11 Nov 2024 01:00:06 +0000
  • Do not modify this file, any contents will be overwritten