be.trud.com
robots.txt
Robots Exclusion Standard data for be.trud.com
Resource Scan
Scan Details
Site Domain | be.trud.com |
Base Domain | trud.com |
Scan Status | Ok |
Last Scan | 2024-09-16T04:23:47+00:00 |
Next Scan | 2024-10-16T04:23:47+00:00 |
Last Scan
Scanned | 2024-09-16T04:23:47+00:00 |
URL | https://be.trud.com/robots.txt |
Domain IPs | 104.21.53.21, 172.67.207.200, 2606:4700:3036::ac43:cfc8, 2606:4700:3037::6815:3515 |
Response IP | 172.67.207.200 |
Found | Yes |
Hash | da662fd8d5b4f8120f72b0554a407f530b69657cb220f3a729d3182f26c1e3e5 |
SimHash | 92962f42ca33 |
Groups
*
Rule | Path |
---|---|
Allow | /company.html?page= |
Disallow | *? |
Disallow | */search/ |
Disallow | /ads/show/ |
Disallow | /jobs/show |
Disallow | /cvs/show |
Disallow | /crm/* |
Disallow | /crm2/* |
Disallow | /resume/ |
Disallow | /resume.html |
Disallow | /js/utils/* |
Disallow | /office/ |
Disallow | /site/redirect/url |
Disallow | */vacancies.html |
Disallow | */leave-feedback.html |
Disallow | */salary.html |
Disallow | */photos.html |
Disallow | */pros-and-cons.html |
Disallow | */about.html |
Disallow | /viewed/ |
Other Records
Field | Value |
---|---|
sitemap | https://be.trud.com/sitemap/be.trud.com-sitemap.xml.gz |
Warnings
- `host` is not a known field.