alem.com.tr
robots.txt

Robots Exclusion Standard data for alem.com.tr

Resource Scan

Scan Details

Site Domain alem.com.tr
Base Domain alem.com.tr
Scan Status Ok
Last Scan2024-11-13T01:00:31+00:00
Next Scan 2024-11-20T01:00:31+00:00

Last Scan

Scanned2024-11-13T01:00:31+00:00
URL https://alem.com.tr/robots.txt
Redirect https://www.alem.com.tr/robots.txt
Redirect Domain www.alem.com.tr
Redirect Base alem.com.tr
Domain IPs 104.21.58.178, 172.67.162.104, 2606:4700:3030::ac43:a268, 2606:4700:3036::6815:3ab2
Redirect IPs 104.21.58.178, 172.67.162.104, 2606:4700:3030::ac43:a268, 2606:4700:3036::6815:3ab2
Response IP 104.21.58.178
Found Yes
Hash 0a94d48a95947fd8f77e6ff603c88e57e8e4cfc674a580a9e501aee1a1ff73b8
SimHash d9065827c5fb

Groups

*

Rule Path
Allow /
Disallow /html/
Disallow /bin/
Disallow /kunyetest
Disallow /test/testpage

Other Records

Field Value
sitemap https://www.alem.com.tr/haberxml/alem-exclusive
sitemap https://www.alem.com.tr/haberxml/luks
sitemap https://www.alem.com.tr/haberxml/moda
sitemap https://www.alem.com.tr/haberxml/sanat
sitemap https://www.alem.com.tr/haberxml/saglik-guzellik
sitemap https://www.alem.com.tr/haberxml/gurme
sitemap https://www.alem.com.tr/haberxml/astroloji
sitemap https://www.alem.com.tr/haberxml/foto-galeri
sitemap https://www.alem.com.tr/haberxml/seyahat-notlari