Log In Sign Up

techlockdown.com
robots.txt

Robots Exclusion Standard data for techlockdown.com

Resource Scan

Scan Details

Site Domain techlockdown.com
Base Domain techlockdown.com
Scan Status Ok
Last Scan2025-10-28T21:09:40+00:00
Next Scan 2025-11-27T21:09:40+00:00

Last Scan

Scanned2025-10-28T21:09:40+00:00
URL https://techlockdown.com/robots.txt
Domain IPs 104.21.18.112, 172.67.181.158, 2606:4700:3030::ac43:b59e, 2606:4700:3033::6815:1270
Response IP 172.67.181.158
Found Yes
Hash 5a67c62f5e2b2d72c8b50c7086743bc9c1a954154f9d44844fa00421498d04c8
SimHash 1f441e556766

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /login/
Disallow /contact/
Disallow /js/
Disallow /*.json$
Disallow /*.txt$
Disallow /*.log$
Back to top

Other Records

Field Value
sitemap https://www.techlockdown.com/sitemap.xml
sitemap https://www.techlockdown.com/guides/sitemap.xml
sitemap https://www.techlockdown.com/es/guías/sitemap.xml
sitemap https://www.techlockdown.com/de/anleitungen/sitemap.xml
sitemap https://www.techlockdown.com/blog/sitemap.xml
sitemap https://www.techlockdown.com/es/blog/sitemap.xml
sitemap https://www.techlockdown.com/de/blog/sitemap.xml
Back to top

Comments

  • robots.txt for Tech Lockdown Web
  • Last updated: 2025-08-19
  • Generally allow all pages
  • Disallow endpoints that shouldn't be indexed
  • Disallow file types that shouldn't be indexed
  • Top-level sitemap
  • Guides sitemaps
  • Blog sitemaps
Back to top