petsser.com
robots.txt
Robots Exclusion Standard data for petsser.com
Resource Scan
Scan Details
Site Domain | petsser.com |
Base Domain | petsser.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-08-03T02:42:42+00:00 |
Next Scan | 2024-10-02T02:42:42+00:00 |
Last Successful Scan
Scanned | 2024-06-05T02:41:41+00:00 |
URL | https://petsser.com/robots.txt |
Domain IPs | 104.21.28.14, 172.67.170.39, 2606:4700:3031::ac43:aa27, 2606:4700:3034::6815:1c0e |
Response IP | 104.21.28.14 |
Found | Yes |
Hash | 6d49929d58ac228158244b5d7de0839ed781a3f653cbe81f948916f798950a75 |
SimHash | 0908dd46a412 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /*.gif$ |
Allow | /*.png$ |
Allow | /*.jpeg$ |
Allow | /*.jpg$ |
Allow | /*.ico$ |
Allow | /*.jpg$ |
Allow | /*.js |
Allow | /*.css |
Allow | /uploads |
Allow | /assets |
Allow | /widgets |
Disallow | /humix |
Other Records
Field | Value |
---|---|
sitemap | https://petsser.com/sitemap_index.xml |
sitemap | https://petsser.com/homzl/sitemap_index.xml |