Log In Sign Up

noobfactories.com
robots.txt

Robots Exclusion Standard data for noobfactories.com

Resource Scan

Scan Details

Site Domain noobfactories.com
Base Domain noobfactories.com
Scan Status Ok
Last Scan2025-10-30T15:47:50+00:00
Next Scan 2025-11-29T15:47:50+00:00

Last Scan

Scanned2025-10-30T15:47:50+00:00
URL https://noobfactories.com/robots.txt
Domain IPs 104.21.49.120, 172.67.162.123, 2606:4700:3033::6815:3178, 2606:4700:3035::ac43:a27b
Response IP 172.67.162.123
Found Yes
Hash 46657aa90d5212e1549155e306e686ba688dd25a0727b98b9dadb319f2d11b0f
SimHash 534dd141ef9b

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

amazonbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

rankmathbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

babbartechbot

Rule Path
Disallow /

aliyunsecbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://noobfactories.com/wp-sitemap.xml
Back to top