divyagoal.com
robots.txt

Robots Exclusion Standard data for divyagoal.com

Resource Scan

Scan Details

Site Domain divyagoal.com
Base Domain divyagoal.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-26T19:08:18+00:00
Next Scan 2025-11-02T19:08:18+00:00

Last Successful Scan

Scanned2025-09-25T17:17:27+00:00
URL https://divyagoal.com/robots.txt
Redirect https://www.divyagoal.com/robots.txt
Redirect Domain www.divyagoal.com
Redirect Base divyagoal.com
Domain IPs 104.21.93.202, 172.67.214.93, 2606:4700:3033::ac43:d65d, 2606:4700:3034::6815:5dca
Redirect IPs 104.21.93.202, 172.67.214.93, 2606:4700:3033::ac43:d65d, 2606:4700:3034::6815:5dca
Response IP 172.67.214.93
Found Yes
Hash 0945903685cdd7a9aa2fb35b75273abad2be183e72ac4042d42db9aa7e86678e
SimHash 6dbd5555d5d2

Groups

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /.well-known/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.divyagoal.com/sitemap.xml