harveylawcorporation.com
robots.txt

Robots Exclusion Standard data for harveylawcorporation.com

Resource Scan

Scan Details

Site Domain harveylawcorporation.com
Base Domain harveylawcorporation.com
Scan Status Ok
Last Scan2025-05-15T09:50:46+00:00
Next Scan 2025-06-14T09:50:46+00:00

Last Scan

Scanned2025-05-15T09:50:46+00:00
URL https://harveylawcorporation.com/robots.txt
Domain IPs 104.26.2.54, 104.26.3.54, 172.67.69.59, 2606:4700:20::681a:236, 2606:4700:20::681a:336, 2606:4700:20::ac43:453b
Response IP 172.67.69.59
Found Yes
Hash 6c061639f041f8014f9f6800406eb9613966f4ccffe9114a4a4917169d284d73
SimHash 6b088c406da0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-includes/
Disallow /feed/
Disallow /comments/feed/
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Allow /french-citizenship-by-descent-find-out-if-you-are-eligible/

Other Records

Field Value
sitemap https://harveylawcorporation.com/post-sitemap.xml
sitemap https://harveylawcorporation.com/page-sitemap.xml
sitemap https://harveylawcorporation.com/category-sitemap.xml

Comments

  • Allow search engines to crawl your entire site
  • Sitemaps
  • Allow search engines to crawl your uploads folder (optional)