slothunter.com
robots.txt
Robots Exclusion Standard data for slothunter.com
Resource Scan
Scan Details
Site Domain | slothunter.com |
Base Domain | slothunter.com |
Scan Status | Ok |
Last Scan | 2024-04-20T07:17:30+00:00 |
Next Scan | 2024-05-20T07:17:30+00:00 |
Last Scan
Scanned | 2024-04-20T07:17:30+00:00 |
URL | https://slothunter.com/robots.txt |
Redirect | https://www.slothunter.com/robots.txt |
Redirect Domain | www.slothunter.com |
Redirect Base | slothunter.com |
Domain IPs | 104.18.32.13, 172.64.155.243 |
Redirect IPs | 104.18.32.13, 172.64.155.243 |
Response IP | 172.64.155.243 |
Found | Yes |
Hash | 7a20ae997af47b0f9e355af3bbe8f740f1c22d1c4f3d12209594cd842606fb12 |
SimHash | 4c3d94156dd7 |
Groups
*
Rule | Path |
---|---|
Disallow | *?sign-in=modal |
Disallow | *?sign-up=modal |
Disallow | /? |
Disallow | /%26 |
Other Records
Field | Value |
---|---|
sitemap | https://www.slothunter.com/sitemap.xml |
Warnings
- 4 invalid lines.