pantau.com
robots.txt

Robots Exclusion Standard data for pantau.com

Resource Scan

Scan Details

Site Domain pantau.com
Base Domain pantau.com
Scan Status Ok
Last Scan2024-06-11T14:24:25+00:00
Next Scan 2024-06-18T14:24:25+00:00

Last Scan

Scanned2024-06-11T14:24:25+00:00
URL https://pantau.com/robots.txt
Redirect https://www.pantau.com/robots.txt
Redirect Domain www.pantau.com
Redirect Base pantau.com
Domain IPs 104.21.47.32, 172.67.144.44, 2606:4700:3031::6815:2f20, 2606:4700:3037::ac43:902c
Redirect IPs 104.21.47.32, 172.67.144.44, 2606:4700:3031::6815:2f20, 2606:4700:3037::ac43:902c
Response IP 104.21.47.32
Found Yes
Hash 34f12a7011ecc6d4fbbe5251f107a15239696f011d61c1cd85ea1cc5f9ee8baa
SimHash 4834d977a9b3

Groups

googlebot

Rule Path
Disallow /search/

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.pantau.com/sitemap.xml