modernawebdesign.com
robots.txt

Robots Exclusion Standard data for modernawebdesign.com

Resource Scan

Scan Details

Site Domain modernawebdesign.com
Base Domain modernawebdesign.com
Scan Status Ok
Last Scan2025-11-13T10:44:38+00:00
Next Scan 2025-12-13T10:44:38+00:00

Last Scan

Scanned2025-11-13T10:44:38+00:00
URL https://modernawebdesign.com/robots.txt
Domain IPs 104.21.39.21, 172.67.142.55, 2606:4700:3033::6815:2715, 2606:4700:3036::ac43:8e37
Response IP 104.21.39.21
Found Yes
Hash 07802c362953b902cc6cad5ebad7cf2c354eb8da63db66c5128971d01de15f9d
SimHash e904d9754941

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.modernawebdesign.com/sitemap_index.xml
sitemap https://www.modernawebdesign.com/post-sitemap.xml
sitemap https://www.modernawebdesign.com/page-sitemap.xml
sitemap https://www.modernawebdesign.com/category-sitemap.xml
sitemap https://www.modernawebdesign.com/post_tag-sitemap.xml
sitemap https://www.modernawebdesign.com/author-sitemap.xml