alareeq.com
robots.txt

Robots Exclusion Standard data for alareeq.com

Resource Scan

Scan Details

Site Domain alareeq.com
Base Domain alareeq.com
Scan Status Ok
Last Scan2024-10-10T15:53:30+00:00
Next Scan 2024-10-17T15:53:30+00:00

Last Scan

Scanned2024-10-10T15:53:30+00:00
URL https://alareeq.com/robots.txt
Redirect https://www.alareeq.com/robots.txt
Redirect Domain www.alareeq.com
Redirect Base alareeq.com
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.175.121, 2404:6800:4003:c02::79
Response IP 142.251.12.121
Found Yes
Hash d82762c41e079f1678d0c9a3adf1dda213f109d5a1defb343b557e59d2a3cc95
SimHash 30454b514d35

Groups

*

Rule Path
Disallow
Disallow /?&max-results=499
Disallow /?start=*

Other Records

Field Value
sitemap https://www.alareeq.com/sitemap.xml?page=1

Comments

  • Allow crawling of the last 500 posts
  • Allow crawling of the last 50 pages