Log In Sign Up

avsubbed.com
robots.txt

Robots Exclusion Standard data for avsubbed.com

Resource Scan

Scan Details

Site Domain avsubbed.com
Base Domain avsubbed.com
Scan Status Ok
Last Scan2026-01-07T01:07:34+00:00
Next Scan 2026-01-14T01:07:34+00:00

Last Scan

Scanned2026-01-07T01:07:34+00:00
URL https://avsubbed.com/robots.txt
Domain IPs 104.21.30.239, 172.67.174.48, 2606:4700:3036::6815:1eef, 2606:4700:3036::ac43:ae30
Response IP 172.67.174.48
Found Yes
Hash 9d33a7993fb54495000fbafe218297a2789e9b8cc218ba99ab2d4c0c25cff76e
SimHash 783088c0e4bb

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /author/
Disallow /search/
Disallow /?s=
Disallow /page/*/?s=
Disallow /wp-json/
Disallow /?rest_route=
Disallow /*?replytocom=
Disallow /*?share=
Disallow /*?filter=
Allow /wp-admin/admin-ajax.php

adsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://avsubbed.com/sitemap_index.xml
Back to top

Comments

  • STRICT SEO-FOCUSED ROBOTS.TXT
  • ---------------------------
  • Block AI / unwanted bots
  • Yoast Sitemap
  • ---------------------------
  • END STRICT SEO BLOCK
Back to top