kholifa.com
robots.txt

Robots Exclusion Standard data for kholifa.com

Resource Scan

Scan Details

Site Domain kholifa.com
Base Domain kholifa.com
Scan Status Ok
Last Scan2024-11-09T02:36:39+00:00
Next Scan 2024-11-16T02:36:39+00:00

Last Scan

Scanned2024-11-09T02:36:39+00:00
URL https://kholifa.com/robots.txt
Domain IPs 213.199.36.109
Response IP 213.199.36.109
Found Yes
Hash 40f2b618603fecb3d7ff83becc4a8b24300a46a02cc75e6ee070e8de7576516d
SimHash 7d285c65c7d3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /img/
Disallow /css/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://kholifa.com/sitemap.xml

Comments

  • Kholifa Network autogenerated robots.txt