rajwadi.com
robots.txt

Robots Exclusion Standard data for rajwadi.com

Resource Scan

Scan Details

Site Domain rajwadi.com
Base Domain rajwadi.com
Scan Status Ok
Last Scan2025-08-15T19:30:32+00:00
Next Scan 2025-09-14T19:30:32+00:00

Last Scan

Scanned2025-08-15T19:30:32+00:00
URL https://rajwadi.com/robots.txt
Domain IPs 104.21.6.11, 172.67.134.36, 2606:4700:3037::6815:60b, 2606:4700:3037::ac43:8624
Response IP 104.21.6.11
Found Yes
Hash c584a5404288f2ca6851e4e9184e3bd49f6a631fa6a3e3780ef62bea92ef5882
SimHash 69009ed3c4b3

Groups

*

Rule Path
Allow

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.rajwadi.com/sitemap.xml

Comments

  • All Crawler