accountsguy.net
robots.txt

Robots Exclusion Standard data for accountsguy.net

Resource Scan

Scan Details

Site Domain accountsguy.net
Base Domain accountsguy.net
Scan Status Ok
Last Scan2024-10-01T13:10:37+00:00
Next Scan 2024-10-08T13:10:37+00:00

Last Scan

Scanned2024-10-01T13:10:37+00:00
URL https://accountsguy.net/robots.txt
Domain IPs 116.206.105.72
Response IP 116.206.105.72
Found Yes
Hash 757003793b4435b860730c127205376b4eafa2f7231d96b4bb533a5936c3cb15
SimHash 3933f823e7d4

Groups

googlebot
googlebot-image
googlebot-news
bingbot
teoma
slurp
duckduckbot
baiduspider
yandexbot
facebot
ia_archiver
*

Product Comment
googlebot Googel Search crowler
googlebot-image Googel Images Search crowler
googlebot-news Googel New Search crowler
bingbot Bing Search crowler
teoma Ask Search crowler
* Ramaining all Search crowler
Rule Path Comment
Allow Allows entire website
Disallow /blog Disallows Directive to blog a specific directory in website
Disallow /developer -
Disallow /scripts -
Disallow /sheets -
Disallow /styles -
Disallow /wp-* Disallows direcotry start with wp- and contains any thing after that with the help of asterisk wild card.
Disallow /wp-*.php Disallows all the files start with wp- and file type .php specific with doller symbol
Disallow /xmlprc.php -
Disallow /readme.html -
Disallow /license.html -

Other Records

Field Value Comment
sitemap https://www.accountsguy.net/feed Website Sitemap