anindigoday.com
robots.txt

Robots Exclusion Standard data for anindigoday.com

Resource Scan

Scan Details

Site Domain anindigoday.com
Base Domain anindigoday.com
Scan Status Ok
Last Scan2025-05-03T13:04:20+00:00
Next Scan 2025-05-10T13:04:20+00:00

Last Scan

Scanned2025-05-03T13:04:20+00:00
URL https://anindigoday.com/robots.txt
Domain IPs 35.212.25.49
Response IP 35.212.25.49
Found Yes
Hash d9f6ca0fa08bed6afe0ed7eb557d0df74076bf6afd7e519cd768387e7e440b47
SimHash 69049c40a2e2

Groups

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://anindigoday.com/sitemap_index.xml