pipedream.com
robots.txt
Robots Exclusion Standard data for pipedream.com
Resource Scan
Scan Details
Site Domain | pipedream.com |
Base Domain | pipedream.com |
Scan Status | Ok |
Last Scan | 2024-11-16T03:01:19+00:00 |
Next Scan | 2024-12-16T03:01:19+00:00 |
Last Scan
Scanned | 2024-11-16T03:01:19+00:00 |
URL | https://pipedream.com/robots.txt |
Domain IPs | 13.227.254.104, 13.227.254.48, 13.227.254.49, 13.227.254.73 |
Response IP | 13.227.254.48 |
Found | Yes |
Hash | 9922d98003f30685ddb3886a549172c522068dfaa72a03777d4816a28c978e56 |
SimHash | 6a108be86796 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/c_*/edit |
Disallow | /actions/a_*/edit |
Disallow | /admin/* |
Disallow | /%40* |
Disallow | /community/admin/ |
Disallow | /community/auth/ |
Disallow | /community/assets/browser-update*.js |
Disallow | /community/email/ |
Disallow | /community/session |
Disallow | /community/user-api-key |
Disallow | /community/*?api_key* |
Disallow | /community/*?*api_key* |
Disallow | /community/badges |
Disallow | /community/u |
Disallow | /community/my |
Disallow | /community/search |
Disallow | /community/tag |
Disallow | /community/g |
Disallow | /community/t/*/*.rss |
Disallow | /community/c/*.rss |
Allow | /%40*/* |