swhosting.com
robots.txt
Robots Exclusion Standard data for swhosting.com
Resource Scan
Scan Details
Site Domain | swhosting.com |
Base Domain | swhosting.com |
Scan Status | Ok |
Last Scan | 2024-09-15T18:32:56+00:00 |
Next Scan | 2024-10-15T18:32:56+00:00 |
Last Scan
Scanned | 2024-09-15T18:32:56+00:00 |
URL | https://swhosting.com/robots.txt |
Domain IPs | 104.26.2.182, 104.26.3.182, 172.67.74.174, 2606:4700:20::681a:2b6, 2606:4700:20::681a:3b6, 2606:4700:20::ac43:4aae |
Response IP | 172.67.74.174 |
Found | Yes |
Hash | c7d65421c8df3e9121c5e9cefa6ed3f6e08c38b9d0a107e53a8fdc2eb2221807 |
SimHash | 10149f4ec692 |
Groups
baiduspider
ahrefsbot
python-urllib
dotbot
semrushbot
seznambot
mj12bot
yandexbot
crazywebcrawler-spider
sogou spider
domain re-animator bot
domainappender
blexbot
mojeekbot
zoombot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /*/hosting/contract |
Disallow | /*/cloud/*/add |
Disallow | /*/cloud/configurador |
Disallow | /*/cloud/app/*/*/add |
Disallow | /*/cloud/app/configurador |
Disallow | /*/cloud/so/*/*/add |
Disallow | /*/cloud/so/configurador |
Disallow | /*/reseller/*/add |
Disallow | /*/reseller/configurador |
Other Records
Field | Value |
---|---|
sitemap | https://www.swhosting.com/sitemap.xml |