becominghuman.ai
robots.txt
Robots Exclusion Standard data for becominghuman.ai
Resource Scan
Scan Details
Site Domain | becominghuman.ai |
Base Domain | becominghuman.ai |
Scan Status | Ok |
Last Scan | 2025-06-30T15:29:13+00:00 |
Next Scan | 2025-07-14T15:29:13+00:00 |
Last Scan
Scanned | 2025-06-30T15:29:13+00:00 |
URL | https://becominghuman.ai/robots.txt |
Redirect | https://becominghuman.ai/robots.txt?gi=01ffe1735d06 |
Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
Response IP | 104.21.96.1 |
Found | Yes |
Hash | e913998019460210d605790e3bd36353746bbf1c67721c028c748d078d364aee |
SimHash | 69143b80c372 |
Groups
*
Rule | Path |
---|---|
Disallow | /m/ |
Disallow | /me/ |
Disallow | /%40me$ |
Disallow | /%40me/ |
Disallow | /*/edit$ |
Disallow | /*/*/edit$ |
Disallow | /media/ |
Disallow | /p/*/share |
Disallow | /r/ |
Disallow | /trending |
Disallow | /search?q$ |
Disallow | /search?q= |
Disallow | /*/search?q= |
Disallow | /*/search/*?q= |
Disallow | /*/*source%3D |
Allow | /_/ |
Allow | /_/api/users/*/meta |
Allow | /_/api/users/*/profile/stream |
Allow | /_/api/posts/*/responses |
Allow | /_/api/posts/*/responsesStream |
Allow | /_/api/posts/*/related |
Other Records
Field | Value |
---|---|
sitemap | https://becominghuman.ai/sitemap/sitemap.xml |
Warnings
- `license` is not a known field.