caindelhi.in
robots.txt

Robots Exclusion Standard data for caindelhi.in

Resource Scan

Scan Details

Site Domain caindelhi.in
Base Domain caindelhi.in
Scan Status Ok
Last Scan2025-09-29T17:52:31+00:00
Next Scan 2025-10-06T17:52:31+00:00

Last Scan

Scanned2025-09-29T17:52:31+00:00
URL https://caindelhi.in/robots.txt
Domain IPs 104.21.73.47, 172.67.140.150, 2606:4700:3035::ac43:8c96, 2606:4700:3036::6815:492f
Response IP 104.21.73.47
Found Yes
Hash 0011a713c4422217a86a38ab4a04ac1e1ccd9c17cc99140d7696c7f78b47bb8f
SimHash 2a08d1730213

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://caindelhi.in/sitemap_index_1.xml
sitemap https://caindelhi.in/sitemap_index_2.xml
sitemap https://caindelhi.in/sitemap_index_3.xml
sitemap https://caindelhi.in/sitemap_index_4.xml
sitemap https://caindelhi.in/sitemap_index_5.xml
sitemap https://caindelhi.in/sitemap_index_6.xml
sitemap https://caindelhi.in/sitemap_index_7.xml
sitemap https://caindelhi.in/sitemap_index_8.xml