Log In Sign Up

bbking.techbang.com
robots.txt

Robots Exclusion Standard data for bbking.techbang.com

Resource Scan

Scan Details

Site Domain bbking.techbang.com
Base Domain techbang.com
Scan Status Ok
Last Scan2025-09-17T18:51:11+00:00
Next Scan 2025-10-17T18:51:11+00:00

Last Scan

Scanned2025-09-17T18:51:11+00:00
URL https://bbking.techbang.com/robots.txt
Redirect https://www.techbang.com/robots.txt
Redirect Domain www.techbang.com
Redirect Base techbang.com
Domain IPs 52.197.165.105, 57.181.77.76
Redirect IPs 52.197.165.105, 57.181.77.76
Response IP 57.181.77.76
Found Yes
Hash ccf67e8cf35769f1c2a03ac0d5e99a999a90a5af6e8092ed72a5e964f4a3f529
SimHash 8a553d0d6450

Groups

*

Rule Path
Disallow */comments*

googlebot

Rule Path
Disallow /login.php
Disallow /search?*
Disallow */comments*

gptbot

Rule Path
Allow /
Disallow /login.php
Disallow /search?*
Disallow */comments*

chatgpt-user

Rule Path
Allow /
Disallow /login.php
Disallow /search?*
Disallow */comments*

oai-searchbot

Rule Path
Allow /
Disallow /login.php
Disallow /search?*
Disallow */comments*

perplexitybot

Rule Path
Allow /
Disallow /login.php
Disallow /search?*
Disallow */comments*

perplexity-user

Rule Path
Allow /
Disallow /login.php
Disallow /search?*
Disallow */comments*

mediapartners-google

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.techbang.com/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top