surgujatimes.in
robots.txt

Robots Exclusion Standard data for surgujatimes.in

Resource Scan

Scan Details

Site Domain surgujatimes.in
Base Domain surgujatimes.in
Scan Status Ok
Last Scan2024-09-24T16:47:44+00:00
Next Scan 2024-10-01T16:47:44+00:00

Last Scan

Scanned2024-09-24T16:47:44+00:00
URL https://surgujatimes.in/robots.txt
Domain IPs 185.151.30.209, 2a07:7800::209
Response IP 185.151.30.209
Found Yes
Hash 774b7708b9a8ec844b682d6ebe4d95e953bd68b5b2de9bdd7098fac6d5f94ea3
SimHash 1845d8c4e932

Groups

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=

adsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://surgujatimes.in/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.