yatharthgupta.co
robots.txt

Robots Exclusion Standard data for yatharthgupta.co

Resource Scan

Scan Details

Site Domain yatharthgupta.co
Base Domain yatharthgupta.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-05T15:13:13+00:00
Next Scan 2026-01-04T15:13:13+00:00

Last Successful Scan

Scanned2025-11-05T07:48:32+00:00
URL https://yatharthgupta.co/robots.txt
Domain IPs 104.21.59.112, 172.67.175.158, 2606:4700:3034::ac43:af9e, 2606:4700:3036::6815:3b70
Response IP 172.67.175.158
Found Yes
Hash f6dc7aa5287a708c194cc78e66f53c493cc5b09d1b40dbf62e0f507c7d1b1e92
SimHash 69445858eb11

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
sitemap https://yatharthgupta.co/sitemap.xml
sitemap https://yatharthgupta.co/news-sitemap.xml