padutip.com
robots.txt

Robots Exclusion Standard data for padutip.com

Resource Scan

Scan Details

Site Domain padutip.com
Base Domain padutip.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-13T03:37:26+00:00
Next Scan 2025-12-13T03:37:26+00:00

Last Successful Scan

Scanned2025-10-14T08:21:54+00:00
URL https://padutip.com/robots.txt
Redirect https://www.padutip.com/robots.txt
Redirect Domain www.padutip.com
Redirect Base padutip.com
Domain IPs 104.21.91.235, 172.67.181.233, 2606:4700:3033::6815:5beb, 2606:4700:3037::ac43:b5e9
Redirect IPs 104.21.91.235, 172.67.181.233, 2606:4700:3033::6815:5beb, 2606:4700:3037::ac43:b5e9
Response IP 104.21.91.235
Found Yes
Hash 4c55f4cb2008698d5a651c85d5cac237b21068f8d1034b8ad520f20db074e761
SimHash 5a1c5965a0b3

Groups

*

Rule Path
Disallow

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.padutip.com/sitemap.xml