pornsubth.com
robots.txt
Robots Exclusion Standard data for pornsubth.com
Resource Scan
Scan Details
Site Domain | pornsubth.com |
Base Domain | pornsubth.com |
Scan Status | Ok |
Last Scan | 2024-04-28T23:44:51+00:00 |
Next Scan | 2024-05-28T23:44:51+00:00 |
Last Scan
Scanned | 2024-04-28T23:44:51+00:00 |
URL | https://pornsubth.com/robots.txt |
Domain IPs | 104.21.81.241, 172.67.192.30, 2606:4700:3034::ac43:c01e, 2606:4700:3035::6815:51f1 |
Response IP | 104.21.81.241 |
Found | Yes |
Hash | a005a45fa1f010cd0537cd849a79ea15045a02126ad90955996987b0a99e188a |
SimHash | a848c8054bb3 |
Groups
*
Rule | Path |
---|---|
Disallow | /config |
Disallow | /inc |
Disallow | /install |
Disallow | /*.zip$ |
Disallow | /*.sql$ |
Disallow | /*.php$ |
Other Records
Field | Value |
---|---|
sitemap | https://pornsubth.com/sitemap.xml |