searchaustralianjobs.com
robots.txt

Robots Exclusion Standard data for searchaustralianjobs.com

Resource Scan

Scan Details

Site Domain searchaustralianjobs.com
Base Domain searchaustralianjobs.com
Scan Status Ok
Last Scan2025-04-29T18:16:07+00:00
Next Scan 2025-05-06T18:16:07+00:00

Last Scan

Scanned2025-04-29T18:16:07+00:00
URL https://searchaustralianjobs.com/robots.txt
Domain IPs 104.21.59.58, 172.67.215.34, 2606:4700:3030::6815:3b3a, 2606:4700:3034::ac43:d722
Response IP 104.21.59.58
Found Yes
Hash b1cecaec9af2d27529a55f2a6087278fa22a2df091bb9e863b624177a1de56ac
SimHash 2d10694ce671

Groups

*

Rule Path
Disallow /google_login/
Disallow /one-tap-login/
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://searchaustralianjobs.com/pages.xml
sitemap https://searchaustralianjobs.com/job_listing1.xml
sitemap https://searchaustralianjobs.com/search1.xml
sitemap https://searchaustralianjobs.com/sitemapindex.xml
sitemap https://searchaustralianjobs.com/searchsitemap.xml
sitemap https://searchaustralianjobs.com/searchsitemap_company.xml
sitemap https://searchaustralianjobs.com/searchsitemap_category.xml
sitemap https://searchaustralianjobs.com/searchsitemap_locations.xml
sitemap https://searchaustralianjobs.com/sitemapindex_pdf.xml
sitemap https://searchaustralianjobs.com/sitemapindex_png.xml
sitemap https://searchaustralianjobs.com/searchsitemap_pdf.xml
sitemap https://searchaustralianjobs.com/searchsitemap_png.xml