sofatutor.com
robots.txt
Robots Exclusion Standard data for sofatutor.com
Resource Scan
Scan Details
Site Domain | sofatutor.com |
Base Domain | sofatutor.com |
Scan Status | Ok |
Last Scan | 2024-09-24T18:41:39+00:00 |
Next Scan | 2024-10-08T18:41:39+00:00 |
Last Scan
Scanned | 2024-09-24T18:41:39+00:00 |
URL | https://sofatutor.com/robots.txt |
Redirect | https://www.sofatutor.com/robots.txt |
Redirect Domain | www.sofatutor.com |
Redirect Base | sofatutor.com |
Domain IPs | 108.157.254.29, 108.157.254.47, 108.157.254.68, 108.157.254.77 |
Redirect IPs | 18.198.38.211, 3.123.55.116, 52.57.141.108 |
Response IP | 18.198.38.211 |
Found | Yes |
Hash | c1b6e8f7d370d8405b43b38d53a9802e315f2e8fceb528db21ede9b09fc9d4bd |
SimHash | c119bc608dc7 |
Groups
*
Rule | Path |
---|---|
Disallow | /account |
Disallow | /admin |
Disallow | /embed |
Disallow | /search |
Disallow | /users |
Disallow | /*/view |
Disallow | /interest/remote |
Disallow | /v/ |
Disallow | /s/ |
Disallow | /mobile_app/ |
Disallow | /*.json* |
Other Records
Field | Value |
---|---|
sitemap | https://www.sofatutor.com/sitemap_index.xml.gz |