record.pt
robots.txt

Robots Exclusion Standard data for record.pt

Resource Scan

Scan Details

Site Domain record.pt
Base Domain record.pt
Scan Status Ok
Last Scan2024-06-15T01:06:20+00:00
Next Scan 2024-06-22T01:06:20+00:00

Last Scan

Scanned2024-06-15T01:06:20+00:00
URL https://record.pt/robots.txt
Redirect https://www.record.pt/robots.txt
Redirect Domain www.record.pt
Redirect Base record.pt
Domain IPs 195.23.36.47
Redirect IPs 88.157.217.145
Response IP 88.157.217.145
Found Yes
Hash b4aef55c958fdf48641890b517acec7e281867bc6003c738ecb8ac95089d96b7
SimHash 5b3d5964c5f3

Groups

openai-crawler

Rule Path
Disallow /

googlebot-bard

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /4196/

Other Records

Field Value
sitemap https://www.record.pt/sitemap
sitemap https://www.record.pt/sitemaps/sitemap.xml