Log In Sign Up

khotab.info
robots.txt

Robots Exclusion Standard data for khotab.info

Resource Scan

Scan Details

Site Domain khotab.info
Base Domain khotab.info
Scan Status Ok
Last Scan2025-10-21T07:36:27+00:00
Next Scan 2025-11-20T07:36:27+00:00

Last Scan

Scanned2025-10-21T07:36:27+00:00
URL https://khotab.info/robots.txt
Redirect https://www.khotab.info/robots.txt
Redirect Domain www.khotab.info
Redirect Base khotab.info
Domain IPs 104.21.50.186, 172.67.165.135, 2606:4700:3032::6815:32ba, 2606:4700:3035::ac43:a587
Redirect IPs 104.21.50.186, 172.67.165.135, 2606:4700:3032::6815:32ba, 2606:4700:3035::ac43:a587
Response IP 172.67.165.135
Found Yes
Hash a14e7af93899a5284112f7fb6fbf8ec9bd74cf266e59753c0cd375d52ca15d17
SimHash a905093544d1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /img/
Disallow /admin/
Back to top

Other Records

Field Value
sitemap https://www.khotab.info/sitemap
Back to top

Comments

  • Check and update the following list of disabled directories.
  • If you support sitemap.xml: Update the actual site address and enable the following line.
Back to top