Log In Sign Up

tiger-recruitment.com
robots.txt

Robots Exclusion Standard data for tiger-recruitment.com

Resource Scan

Scan Details

Site Domain tiger-recruitment.com
Base Domain tiger-recruitment.com
Scan Status Ok
Last Scan2024-05-23T02:38:24+00:00
Next Scan 2024-06-22T02:38:24+00:00

Last Scan

Scanned2024-05-23T02:38:24+00:00
URL https://tiger-recruitment.com/robots.txt
Domain IPs 104.26.4.119, 104.26.5.119, 172.67.75.119, 2606:4700:20::681a:477, 2606:4700:20::681a:577, 2606:4700:20::ac43:4b77
Response IP 172.67.75.119
Found Yes
Hash 05bb8517914c14fe859eafac3cbca87177ec119a422c446e7851c11c458eb6cc
SimHash 70d40b10ef21

Groups

scrapy

Rule Path
Allow /

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*search/
Disallow /*?s=*
Disallow /*?query=*
Disallow /*?orderby=*
Disallow /*?form=*
Disallow /*/feed/
Disallow /*?results=*
Disallow /*?archive=*
Disallow /*?area*
Disallow /*?category*
Disallow /*?type*
Back to top

Other Records

Field Value
sitemap https://tiger-recruitment.com/sitemap_index.xml
Back to top

Comments

  • added as per SEO recommendations Mar 2024: https://gotripod.eu.teamwork.com/app/tasks/32998503
  • end Mar 2024
Back to top