astrologerdangwal.com
robots.txt

Robots Exclusion Standard data for astrologerdangwal.com

Resource Scan

Scan Details

Site Domain astrologerdangwal.com
Base Domain astrologerdangwal.com
Scan Status Ok
Last Scan2025-09-01T00:24:04+00:00
Next Scan 2025-09-08T00:24:04+00:00

Last Scan

Scanned2025-09-01T00:24:04+00:00
URL http://astrologerdangwal.com/robots.txt
Redirect http://www.astrologerdangwal.com/robots.txt
Redirect Domain www.astrologerdangwal.com
Redirect Base astrologerdangwal.com
Domain IPs 184.168.117.94
Redirect IPs 184.168.117.94
Response IP 184.168.117.94
Found Yes
Hash ba57efa5070dbcce6a01b1040565ffcdd1add1abfa1e278455e84ac3bd629cb0
SimHash e80958818f83

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /commons
Disallow /js
Disallow /css
Disallow /images
Disallow /admin
Disallow /new-site
Disallow /font-awesome
Disallow /fonts

bingbot

Rule Path
Disallow /commons
Disallow /js
Disallow /css
Disallow /images
Disallow /admin
Disallow /new-site
Disallow /font-awesome
Disallow /fonts

yahoo! slurp

Rule Path
Disallow /commons
Disallow /js
Disallow /css
Disallow /images
Disallow /admin
Disallow /new-site
Disallow /font-awesome
Disallow /fonts

Other Records

Field Value
sitemap http://www.astrologerdangwal.com/sitemap.xml