webseeder.in
robots.txt

Robots Exclusion Standard data for webseeder.in

Resource Scan

Scan Details

Site Domain webseeder.in
Base Domain webseeder.in
Scan Status Ok
Last Scan2025-08-17T00:47:50+00:00
Next Scan 2025-09-16T00:47:50+00:00

Last Scan

Scanned2025-08-17T00:47:50+00:00
URL https://webseeder.in/robots.txt
Redirect https://www.webseeder.in/robots.txt
Redirect Domain www.webseeder.in
Redirect Base webseeder.in
Domain IPs 2a02:4780:84:363f:4359:8cb2:f47:7b0, 2a02:4780:84:d833:1936:6d8b:440:37a3, 84.32.84.124, 84.32.84.179
Redirect IPs 2a02:4780:84:7b92:57a9:7d00:fad:e7b2, 2a02:4780:84:f0c7:920a:8c74:2195:7815, 84.32.84.171, 84.32.84.95
Response IP 191.101.228.21
Found Yes
Hash 967c1ea2215f83036f6f15cf611f2d7d2a1fe8271ce5698d4806347bbbd6d95b
SimHash 6c094874c6b0

Groups

*

Rule Path
Disallow /admin/
Disallow /private/
Disallow /confidential/
Disallow /tmp/
Disallow /cgi-bin/
Allow /services/
Allow /blog/

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.webseeder.in/sitemap.xml