searchamericanjobs.com
robots.txt

Robots Exclusion Standard data for searchamericanjobs.com

Resource Scan

Scan Details

Site Domain searchamericanjobs.com
Base Domain searchamericanjobs.com
Scan Status Ok
Last Scan2025-04-23T18:01:09+00:00
Next Scan 2025-04-30T18:01:09+00:00

Last Scan

Scanned2025-04-23T18:01:09+00:00
URL https://searchamericanjobs.com/robots.txt
Domain IPs 104.21.82.208, 172.67.163.94, 2606:4700:3031::6815:52d0, 2606:4700:3036::ac43:a35e
Response IP 172.67.163.94
Found Yes
Hash 4661f91b111fc43dd8ebd992f6f87fbcfbc4cd370a5846d408e04ff551ca7660
SimHash bd8c8120e8a0

Groups

*

Rule Path
Disallow /google_login/
Disallow /one-tap-login/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://searchamericanjobs.com/pages.xml
sitemap https://searchamericanjobs.com/job_listing1.xml
sitemap https://searchamericanjobs.com/search1.xml
sitemap https://searchamericanjobs.com/sitemapindex.xml
sitemap https://searchamericanjobs.com/searchsitemap.xml
sitemap https://searchamericanjobs.com/searchsitemap_company.xml
sitemap https://searchamericanjobs.com/searchsitemap_category.xml
sitemap https://searchamericanjobs.com/searchsitemap_locations.xml
sitemap https://searchamericanjobs.com/sitemapindex_pdf.xml
sitemap https://searchamericanjobs.com/sitemapindex_png.xml
sitemap https://searchamericanjobs.com/searchsitemap_pdf.xml
sitemap https://searchamericanjobs.com/searchsitemap_png.xml