captel.com
robots.txt
Robots Exclusion Standard data for captel.com
Resource Scan
Scan Details
Site Domain | captel.com |
Base Domain | captel.com |
Scan Status | Ok |
Last Scan | 2024-06-09T05:02:01+00:00 |
Next Scan | 2024-07-09T05:02:01+00:00 |
Last Scan
Scanned | 2024-06-09T05:02:01+00:00 |
URL | https://captel.com/robots.txt |
Domain IPs | 162.218.1.164 |
Response IP | 162.218.1.164 |
Found | Yes |
Hash | 6d0352b886f86c0a418467de43920e828b096551483df67a0bb5876a1e8f831b |
SimHash | 72e152a3c8ea |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/uploads/ |
Allow | /?display=wide |
Disallow | /wp-content/plugins/ |
Disallow | /?s= |
Disallow | /search/ |
Disallow | /author/ |
Disallow | /literature/ |
Disallow | /livehelp/ |
Disallow | /lists/ |
Disallow | /newsletter/ |
Disallow | /media/ |
Disallow | /tv/ |
Disallow | /tshirt/ |
Disallow | /feed/ |
Disallow | /readme.html |
Disallow | /refer/ |
Disallow | /wp-login.php |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 2.0 |
Warnings
- 6 invalid lines.
Comments