pipedream.com
robots.txt

Robots Exclusion Standard data for pipedream.com

Resource Scan

Scan Details

Site Domain pipedream.com
Base Domain pipedream.com
Scan Status Ok
Last Scan2024-04-20T02:36:09+00:00
Next Scan 2024-05-20T02:36:09+00:00

Last Scan

Scanned2024-04-20T02:36:09+00:00
URL https://pipedream.com/robots.txt
Domain IPs 13.227.254.104, 13.227.254.48, 13.227.254.49, 13.227.254.73
Response IP 13.227.254.48
Found Yes
Hash 9922d98003f30685ddb3886a549172c522068dfaa72a03777d4816a28c978e56
SimHash 6a108be86796

Groups

*

Rule Path
Disallow /*/c_*/edit
Disallow /actions/a_*/edit
Disallow /admin/*
Disallow /%40*
Disallow /community/admin/
Disallow /community/auth/
Disallow /community/assets/browser-update*.js
Disallow /community/email/
Disallow /community/session
Disallow /community/user-api-key
Disallow /community/*?api_key*
Disallow /community/*?*api_key*
Disallow /community/badges
Disallow /community/u
Disallow /community/my
Disallow /community/search
Disallow /community/tag
Disallow /community/g
Disallow /community/t/*/*.rss
Disallow /community/c/*.rss
Allow /%40*/*