techbeon.com
robots.txt

Robots Exclusion Standard data for techbeon.com

Resource Scan

Scan Details

Site Domain techbeon.com
Base Domain techbeon.com
Scan Status Ok
Last Scan2025-10-18T23:37:33+00:00
Next Scan 2025-10-25T23:37:33+00:00

Last Scan

Scanned2025-10-18T23:37:33+00:00
URL https://techbeon.com/robots.txt
Redirect https://tfinnetwork.io/robots.txt
Redirect Domain tfinnetwork.io
Redirect Base tfinnetwork.io
Domain IPs 104.21.58.29, 172.67.155.75, 2606:4700:3032::6815:3a1d, 2606:4700:3035::ac43:9b4b
Redirect IPs 104.21.26.116, 172.67.168.67, 2606:4700:3032::6815:1a74, 2606:4700:3034::ac43:a843
Response IP 172.67.168.67
Found Yes
Hash 6a6fc568d9c71bb5a7e0e991f967c700f865f3222e5a026f7ea577aca3809563
SimHash 4c145a5ac472

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php*
Disallow /customize.php*
Disallow /?S=
Disallow /p%3D*
Disallow /?p=*
Disallow /wp-ison/
Disallow /xmlrpc.php*
Disallow /comment.php*
Disallow /wp-includes/
Disallow /plugins/
Disallow /themes/
Allow /uploads/
Allow /?a=
Allow /?brandcode=
Allow /

googlebot

Rule Path
Disallow /feed/
Disallow /feed$
Disallow /comments/
Disallow /?add-to-cart=
Disallow /?add_to_wishlist=

Other Records

Field Value
sitemap https://tfinnetwork.io/sitemap_index.xml

Comments

  • All bots
  • Googlebot
  • Sitemap