microperts.com
robots.txt

Robots Exclusion Standard data for microperts.com

Resource Scan

Scan Details

Site Domain microperts.com
Base Domain microperts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-11T20:27:58+00:00
Next Scan 2025-12-18T20:27:58+00:00

Last Successful Scan

Scanned2025-12-01T17:52:31+00:00
URL http://microperts.com/robots.txt
Domain IPs 66.29.137.48
Response IP 66.29.137.48
Found Yes
Hash aad16ec8d83466b14a9c9840775a431be7c2dc23c0499955b49259e1ea5342d8
SimHash 4d204a50d693

Groups

*

Rule Path
Disallow /private/
Disallow /temp/
Disallow /cgi-bin/
Allow /

*

Rule Path
Allow /wp-content/uploads/2024/11/cropped-logo_icon_small.png

badbot

Rule Path
Disallow /

anotherbadbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://microperts.com/sitemap.xml

Comments

  • Allow all other pages
  • Explicitly allow favicon
  • Specific bots exclusions
  • Sitemap location