everylittled.com
robots.txt

Robots Exclusion Standard data for everylittled.com

Resource Scan

Scan Details

Site Domain everylittled.com
Base Domain everylittled.com
Scan Status Ok
Last Scan2024-11-04T23:51:09+00:00
Next Scan 2024-11-11T23:51:09+00:00

Last Scan

Scanned2024-11-04T23:51:09+00:00
URL https://everylittled.com/robots.txt
Domain IPs 34.160.188.69
Response IP 34.160.188.69
Found Yes
Hash 09d00449e6be2a2838c59cba743ee962b6c34d50bc87cef10fad3a8466ac308e
SimHash 4a149970e511

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

*

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /search
Disallow /api/article/infinite

Other Records

Field Value
sitemap https://everylittled.com/sitemap.xml