wplocker.net
robots.txt

Robots Exclusion Standard data for wplocker.net

Resource Scan

Scan Details

Site Domain wplocker.net
Base Domain wplocker.net
Scan Status Ok
Last Scan2025-12-20T17:44:06+00:00
Next Scan 2025-12-27T17:44:06+00:00

Last Scan

Scanned2025-12-20T17:44:06+00:00
URL https://wplocker.net/robots.txt
Domain IPs 104.21.31.62, 172.67.175.56, 2606:4700:3031::6815:1f3e, 2606:4700:3037::ac43:af38
Response IP 172.67.175.56
Found Yes
Hash 2795cd385efe98059bdb7f53077451bd674b3103c19e7384dab0d0a23d61db23
SimHash 01282a53e2f4

Groups

*

Rule Path
Allow /
Allow /review/
Allow /category/
Allow /author/
Allow /index.php
Allow /review.php
Allow /category.php
Allow /author.php
Allow /about.php
Allow /contact.php
Allow /search.php
Disallow /admin/
Disallow /includes/
Disallow /templates/
Disallow /cron/
Disallow /backup/
Disallow /vendor/
Disallow /includes/submit_comment.php
Disallow /includes/rate_review.php
Disallow /includes/subscribe.php
Disallow /*.sql$
Disallow /*.log$
Disallow /*.bak$
Disallow /*.json$
Disallow /*.yml$
Disallow /*.yaml$
Disallow /*.env$
Disallow /*.config$
Disallow /*.example$
Disallow /*.sample$
Disallow /*.lock$

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.yourdomain.com/sitemap.xml

Comments

  • Website Robots.txt file
  • https://www.robotstxt.org/
  • Disallow admin and includes directories
  • Disallow form handlers
  • Disallow specific file types
  • Crawl-delay directive (in seconds)
  • Sitemap location