alsahil.net
robots.txt

Robots Exclusion Standard data for alsahil.net

Resource Scan

Scan Details

Site Domain alsahil.net
Base Domain alsahil.net
Scan Status Ok
Last Scan2025-02-17T03:26:55+00:00
Next Scan 2025-03-19T03:26:55+00:00

Last Scan

Scanned2025-02-17T03:26:55+00:00
URL https://alsahil.net/robots.txt
Domain IPs 104.21.95.87, 172.67.170.60, 2606:4700:3033::ac43:aa3c, 2606:4700:3037::6815:5f57
Response IP 172.67.170.60
Found Yes
Hash 14146cc59098c0c3410e193c526810a96f3ee1ef795f9febf54303ae5bd6649a
SimHash 2808dce0cab3

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

semrushbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.alsahil.net/sitemap.php