digitalscouting.in
robots.txt

Robots Exclusion Standard data for digitalscouting.in

Resource Scan

Scan Details

Site Domain digitalscouting.in
Base Domain digitalscouting.in
Scan Status Ok
Last Scan2025-09-21T15:05:20+00:00
Next Scan 2025-09-28T15:05:20+00:00

Last Scan

Scanned2025-09-21T15:05:20+00:00
URL https://www.digitalscouting.in/robots.txt
Domain IPs 2404:6800:4003:c05::79, 74.125.200.121
Response IP 64.233.170.121
Found Yes
Hash 86e1b4cd908f36e878ea910b2f6e17263568afb67b88895af55af52ba6fd2b4d
SimHash c945d911ffd3

Groups

*

Rule Path
Allow /search
Disallow /Category/
Disallow /tag/
Allow /

Other Records

Field Value
sitemap https://www.digitalscouting.in/atom.xml?redirect=false&start-index=1&max-results=500
sitemap https://www.digitalscouting.in/atom.xml?redirect=false&start-index=501&max-results=500
sitemap https://www.digitalscouting.in/atom.xml?redirect=false&start-index=1001&max-results=500