amp.expresso.pt
robots.txt

Robots Exclusion Standard data for amp.expresso.pt

Resource Scan

Scan Details

Site Domain amp.expresso.pt
Base Domain expresso.pt
Scan Status Ok
Last Scan2024-05-11T06:34:45+00:00
Next Scan 2024-05-18T06:34:45+00:00

Last Scan

Scanned2024-05-11T06:34:45+00:00
URL https://amp.expresso.pt/robots.txt
Domain IPs 2600:9000:25ef:1c00:a:942:5e80:93a1, 2600:9000:25ef:4400:a:942:5e80:93a1, 2600:9000:25ef:5400:a:942:5e80:93a1, 2600:9000:25ef:6000:a:942:5e80:93a1, 2600:9000:25ef:9600:a:942:5e80:93a1, 2600:9000:25ef:9c00:a:942:5e80:93a1, 2600:9000:25ef:ba00:a:942:5e80:93a1, 2600:9000:25ef:f600:a:942:5e80:93a1, 99.84.203.22, 99.84.203.25, 99.84.203.39, 99.84.203.57
Response IP 18.165.171.62
Found Yes
Hash f68e9759bd2ab9adf822bb862b9fdb52fb1a46d07183847d3c1e0f7fd7b682d6
SimHash 2814d150ab11

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

*

Rule Path
Disallow /api
Disallow /sites
Disallow /sandbox
Disallow /recursos
Disallow /resources
Allow /

Other Records

Field Value
sitemap https://expresso.pt/sitemap/news.xml
sitemap https://expresso.pt/sitemap/index.xml
sitemap https://expresso.pt/sitemap/videos.xml