custome.me
robots.txt
Robots Exclusion Standard data for custome.me
Resource Scan
Scan Details
Site Domain | custome.me |
Base Domain | custome.me |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-04-05T23:46:41+00:00 |
Next Scan | 2024-07-04T23:46:41+00:00 |
Last Successful Scan
Scanned | 2023-06-08T06:24:29+00:00 |
URL | https://custome.me/robots.txt |
Domain IPs | 52.84.251.115, 52.84.251.21, 52.84.251.85, 52.84.251.95 |
Response IP | 18.164.116.92 |
Found | Yes |
Hash | 56590749aec8a5f847a8d9dc6b9f11515e76ee8777be427e6f6cbd5bbaf08c2f |
SimHash | 7b0999474f96 |
Groups
*
Rule | Path |
---|---|
Disallow | /info/delete |
Disallow | /home/notice |
Disallow | /home/follows |
Disallow | /top/shop |
Disallow | /api/* |
Other Records
Field | Value |
---|---|
sitemap | https://custome.me/sitemap.xml |