al3arabi.com
robots.txt

Robots Exclusion Standard data for al3arabi.com

Resource Scan

Scan Details

Site Domain al3arabi.com
Base Domain al3arabi.com
Scan Status Ok
Last Scan2024-06-08T03:39:23+00:00
Next Scan 2024-06-15T03:39:23+00:00

Last Scan

Scanned2024-06-08T03:39:23+00:00
URL https://al3arabi.com/robots.txt
Domain IPs 104.26.8.138, 104.26.9.138, 172.67.71.90, 2606:4700:20::681a:88a, 2606:4700:20::681a:98a, 2606:4700:20::ac43:475a
Response IP 104.26.9.138
Found Yes
Hash d1f79e6720f0c3218de6adeb27c0dd031ebb72dcbe72e4396fd6a6542ee95bb7
SimHash 080d2c028b93

Groups

*

Rule Path
Disallow /search?q

Other Records

Field Value
sitemap https://al3arabi.com/sitemap/website-sitemap.index.xml
sitemap https://al3arabi.com/sitemap/google-news-sitemap.index.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449