aboredcoder.com
robots.txt
Robots Exclusion Standard data for aboredcoder.com
Resource Scan
Scan Details
Site Domain | aboredcoder.com |
Base Domain | aboredcoder.com |
Scan Status | Ok |
Last Scan | 2024-11-04T10:30:26+00:00 |
Next Scan | 2024-11-11T10:30:26+00:00 |
Last Scan
Scanned | 2024-11-04T10:30:26+00:00 |
URL | https://aboredcoder.com/robots.txt |
Domain IPs | 104.21.76.180, 172.67.198.103, 2606:4700:3032::ac43:c667, 2606:4700:3034::6815:4cb4 |
Response IP | 104.21.76.180 |
Found | Yes |
Hash | 4ae5319593e3dab61b11ea4d9922c8356869c9f5b9f9d1ed5672d10799bc5378 |
SimHash | 79158984c193 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /user/ |
Disallow | /static/css/ |
Disallow | /static/js/ |
Disallow | /static/images/ |
Disallow | /static/font/ |
Disallow | /static/media/ |
Other Records
Field | Value |
---|---|
sitemap | /sitemap.xml |