talent.com
robots.txt
Robots Exclusion Standard data for talent.com
Resource Scan
Scan Details
Site Domain | talent.com |
Base Domain | talent.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-15T01:35:25+00:00 |
Next Scan | 2024-11-13T01:35:25+00:00 |
Last Successful Scan
Scanned | 2024-04-18T01:32:44+00:00 |
URL | https://www.talent.com/robots.txt |
Domain IPs | 104.18.39.50, 172.64.148.206 |
Response IP | 172.64.148.206 |
Found | Yes |
Hash | 2a4614432ca09e21c9f41861c19f563d9e625d74428754f57d5c29a05e034035 |
SimHash | a28c4b4c675a |
Groups
*
Rule | Path |
---|---|
Disallow | /redirect* |
Disallow | /invoice-report?token* |
Disallow | /ajax/* |
Disallow | /ar/redirect* |
Disallow | /pt/redirect* |
Disallow | /es/redirect* |
Disallow | /de/redirect* |
Disallow | /en/redirect* |
Disallow | /nl/redirect* |
Disallow | /fr/redirect* |
Disallow | /it/redirect* |
Disallow | /cn/redirect* |
Disallow | /cs/redirect* |
Disallow | /da/redirect* |
Disallow | /fi/redirect* |
Disallow | /el/redirect* |
Disallow | /zh/redirect* |
Disallow | /hu/redirect* |
Disallow | /id/redirect* |
Disallow | /he/redirect* |
Disallow | /ja/redirect* |
Disallow | /ko/redirect* |
Disallow | /ru/redirect* |
Disallow | /ms/redirect* |
Disallow | /no/redirect* |
Disallow | /pl/redirect* |
Disallow | /ro/redirect* |
Disallow | /sv/redirect* |
Disallow | /tr/redirect* |
Disallow | /th/redirect* |
Disallow | /uk/redirect* |
Disallow | /vi/redirect* |
Other Records
Field | Value |
---|---|
sitemap | https://www.talent.com/sitemap-serp-en.xml |
sitemap | https://www.talent.com/sitemap-serp-en-1.xml |
sitemap | https://www.talent.com/sitemap-serp-en-2.xml |
sitemap | https://www.talent.com/sitemap-serp-en-3.xml |
sitemap | https://www.talent.com/sitemap-serp-en-4.xml |
sitemap | https://www.talent.com/sitemap-serp-en-5.xml |
sitemap | https://www.talent.com/sitemap-serp-en-6.xml |
sitemap | https://www.talent.com/sitemap-serp-en-7.xml |
sitemap | https://www.talent.com/sitemap-serp-en-8.xml |
sitemap | https://www.talent.com/sitemap-serp-en-9.xml |
sitemap | https://www.talent.com/sitemap-serp-en-10.xml |
sitemap | https://www.talent.com/sitemap-serp-en-11.xml |
sitemap | https://www.talent.com/sitemap-serp-en-12.xml |
sitemap | https://www.talent.com/sitemap-serp-en-13.xml |
sitemap | https://www.talent.com/sitemap-serp-en-14.xml |
sitemap | https://www.talent.com/sitemap-serp-en-15.xml |
sitemap | https://www.talent.com/sitemap-serp-en-16.xml |
sitemap | https://www.talent.com/sitemap-serp-en-17.xml |
sitemap | https://www.talent.com/sitemap-serp-en-18.xml |