trud.com
robots.txt
Robots Exclusion Standard data for trud.com
Resource Scan
Scan Details
Site Domain | trud.com |
Base Domain | trud.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-21T01:26:20+00:00 |
Next Scan | 2024-11-20T01:26:20+00:00 |
Last Successful Scan
Scanned | 2024-09-22T00:48:50+00:00 |
URL | https://trud.com/robots.txt |
Domain IPs | 104.21.53.21, 172.67.207.200, 2606:4700:3036::ac43:cfc8, 2606:4700:3037::6815:3515 |
Response IP | 104.21.53.21 |
Found | Yes |
Hash | 2ae3d0eeb3918957db2db7df434112407ab7f0e403ad41a03432f6a1a55bcfc7 |
SimHash | 3294eb42ca73 |
Groups
*
Rule | Path |
---|---|
Allow | /company.html?page= |
Allow | /css/min/main.min.css? |
Allow | /css/min/main-trudcom.min.css? |
Allow | /css/min/main-trudcom-book.min.css? |
Disallow | *? |
Disallow | */search/ |
Disallow | /crm/* |
Disallow | /crm2/* |
Disallow | /rabo$ |
Disallow | /rabota.ua/ |
Disallow | /ua |
Disallow | /office/ |
Disallow | /site/redirect/url |
Disallow | */vacancies.html |
Disallow | */leave-feedback.html |
Disallow | */photos.html |
Disallow | */pros-and-cons.html |
Disallow | */about.html |
Disallow | /viewed/ |
Disallow | /training/ |
Disallow | /event/ |
yandexbot
Rule | Path |
---|---|
Allow | /company.html?page= |
Disallow | *? |
Disallow | */search/ |
Disallow | /ads/show/ |
Disallow | /jobs/show |
Disallow | /cvs/show |
Disallow | /crm/* |
Disallow | /crm2/* |
Disallow | /resume/ |
Disallow | /resume.html |
Disallow | /moscow |
Disallow | /rabo$ |
Disallow | /rabota.ua/ |
Disallow | /ua |
Disallow | /js/utils/* |
Disallow | /office/ |
Disallow | /site/redirect/url |
Disallow | */vacancies.html |
Disallow | */leave-feedback.html |
Disallow | */salary.html |
Disallow | */photos.html |
Disallow | */pros-and-cons.html |
Disallow | */about.html |
Disallow | /viewed/ |
Disallow | /training/ |
Disallow | /event/ |
Other Records
Field | Value |
---|---|
sitemap | https://trud.com/sitemap/en-trud.com-sitemap.xml.gz |
sitemap | https://trud.com/sitemap/ru-trud.com-sitemap.xml.gz |
sitemap | https://trud.com/sitemap/ua-trud.com-sitemap.xml.gz |
Warnings
- `host` is not a known field.