thestarnewsnetwork.com
robots.txt

Robots Exclusion Standard data for thestarnewsnetwork.com

Resource Scan

Scan Details

Site Domain thestarnewsnetwork.com
Base Domain thestarnewsnetwork.com
Scan Status Ok
Last Scan2024-09-24T06:20:36+00:00
Next Scan 2024-10-01T06:20:36+00:00

Last Scan

Scanned2024-09-24T06:20:36+00:00
URL https://thestarnewsnetwork.com/robots.txt
Domain IPs 104.21.95.66, 172.67.143.122, 2606:4700:3031::ac43:8f7a, 2606:4700:3037::6815:5f42
Response IP 172.67.143.122
Found Yes
Hash 7de7ebb03794500f3eee194c26fd530ff4027010526e24f76a2804dd12cf9124
SimHash e543900a6fa4

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin

Other Records

Field Value
sitemap https://thestarnewsnetwork.com/http://thestarnewsnetwork.com/sitemap_index.xml

Comments

  • Robots.txt generated by Booter - Crwalers Manager at Mon, 23 Sep 2024 01:00:02 +0000
  • Do not modify this file, any contents will be overwritten