playpaste.com
robots.txt
Robots Exclusion Standard data for playpaste.com
Resource Scan
Scan Details
Site Domain | playpaste.com |
Base Domain | playpaste.com |
Scan Status | Ok |
Last Scan | 2024-11-14T02:40:12+00:00 |
Next Scan | 2024-11-21T02:40:12+00:00 |
Last Scan
Scanned | 2024-11-14T02:40:12+00:00 |
URL | https://playpaste.com/robots.txt |
Domain IPs | 104.21.66.240, 172.67.165.223, 2606:4700:3032::ac43:a5df, 2606:4700:3037::6815:42f0 |
Response IP | 104.21.66.240 |
Found | Yes |
Hash | b8f95e751f94c919a13a823d6e85a2847406f62dc09c2208f383257ca0ff3542 |
SimHash | c8d45bb071ca |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /tmp/ |
Disallow | /junk/ |
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /search |
*
Rule | Path |
---|---|
Disallow | /trackback |
Disallow | /*trackback |
Disallow | /*trackback* |
Disallow | /*/trackback |
*
Rule | Path |
---|---|
Allow | /feed/$ |
Disallow | /feed/ |
Disallow | /comments/feed/ |
Disallow | /*/feed/$ |
Disallow | /*/feed/rss/$ |
Disallow | /*/trackback/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/trackback/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/trackback/$ |
Warnings
- 13 invalid lines.