politis.com.cy
robots.txt

Robots Exclusion Standard data for politis.com.cy

Resource Scan

Scan Details

Site Domain politis.com.cy
Base Domain politis.com.cy
Scan Status Ok
Last Scan2024-11-15T14:43:16+00:00
Next Scan 2024-11-22T14:43:16+00:00

Last Scan

Scanned2024-11-15T14:43:16+00:00
URL https://politis.com.cy/robots.txt
Domain IPs 104.21.2.22, 172.67.128.153, 2606:4700:3033::6815:216, 2606:4700:3035::ac43:8099
Response IP 172.67.128.153
Found Yes
Hash d42783718363804d53e32fc14b7c6a2c7958f685b3aec91814d2c8230c3a9600
SimHash 69185970c5d5

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

mediapartners-google

Rule Path
Allow /
Disallow /Admin/
Disallow /App_Code/
Disallow /App_Data/
Disallow /bin/
Disallow /temp/
Disallow /logs/
Disallow /styles/
Disallow /Scripts/
Disallow /Global/
Disallow /www/
Disallow /Handlers/

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://politis.com.cy/sitemaps/sitemap.xml