microdevsys.com
robots.txt

Robots Exclusion Standard data for microdevsys.com

Resource Scan

Scan Details

Site Domain microdevsys.com
Base Domain microdevsys.com
Scan Status Ok
Last Scan2025-06-19T09:13:18+00:00
Next Scan 2025-06-26T09:13:18+00:00

Last Scan

Scanned2025-06-19T09:13:18+00:00
URL https://microdevsys.com/robots.txt
Domain IPs 74.208.236.205
Response IP 74.208.236.205
Found Yes
Hash f20743da6cd8ce102aa4a8a18f3cf28318ede9aaf99f61d142947aa5c4a6fbe5
SimHash f41dc84189b0

Groups

*

Rule Path
Disallow /photoalbum/*
Disallow /info.php
Disallow /post%3D40
Disallow /wp/post%3D40
Disallow /wp/?cat=1
Disallow /wp/?adoc=jenny%2Bmccarthy
Disallow /wp/info.php
Disallow /wp/category/uncategorized/
Disallow /wp/wp-trackback.php?p=
Disallow /*.js$
Disallow /?adoc=jenny%2Bmccarthy
Disallow /*.css$
Disallow /cgi-bin/
Disallow /blog.php
Disallow /KingVaughan/
Disallow /?adoc=jenny%2Bmccarthy
Disallow /WordPress/2010/07/04/
Disallow /KingVaughan/May09_2010_1330_1402/
Disallow /KingVaughan/Apr15_2010_1321-1336/
Disallow /KingVaughan/May30_2010_0730-0830/
Disallow /website-backup*

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://microdevsys.com/wp/sitemap.xml

Warnings

  • 1 invalid line.