amjadalkhaleej.com
robots.txt

Robots Exclusion Standard data for amjadalkhaleej.com

Resource Scan

Scan Details

Site Domain amjadalkhaleej.com
Base Domain amjadalkhaleej.com
Scan Status Ok
Last Scan2025-10-05T18:17:28+00:00
Next Scan 2025-11-04T18:17:28+00:00

Last Scan

Scanned2025-10-05T18:17:28+00:00
URL https://amjadalkhaleej.com/robots.txt
Domain IPs 104.21.46.95, 172.67.137.85, 2606:4700:3032::6815:2e5f, 2606:4700:3033::ac43:8955
Response IP 104.21.46.95
Found Yes
Hash f3001db03a6f9d8d524d2a9822c806347b700af3ffaa2c10aa4534d3fae4a3b8
SimHash 684041520733

Groups

*

Rule Path
Allow /
Allow /wp-content/uploads/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /trackback
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$

Other Records

Field Value
sitemap https://www.amjadalkhaleej.com/sitemap_index.xml

Comments

  • We de-index the login page (unnecessary content)