shabab2.com
robots.txt

Robots Exclusion Standard data for shabab2.com

Resource Scan

Scan Details

Site Domain shabab2.com
Base Domain shabab2.com
Scan Status Ok
Last Scan2024-10-05T10:28:40+00:00
Next Scan 2024-10-12T10:28:40+00:00

Last Scan

Scanned2024-10-05T10:28:40+00:00
URL https://shabab2.com/robots.txt
Redirect https://www.shabab2.com/robots.txt
Redirect Domain www.shabab2.com
Redirect Base shabab2.com
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Redirect IPs 104.21.4.49, 172.67.131.171, 2606:4700:3031::6815:431, 2606:4700:3032::ac43:83ab
Response IP 104.21.4.49
Found Yes
Hash bf9c5cd650b4bfa661644e7bb97f9924808f614bae81b01a313f0bc19e0fa697
SimHash 2b04d660c713

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.shabab2.com/sitemap.xml