Log In Sign Up

h1b.biz
robots.txt

Robots Exclusion Standard data for h1b.biz

Resource Scan

Scan Details

Site Domain h1b.biz
Base Domain h1b.biz
Scan Status Ok
Last Scan2024-10-23T05:43:42+00:00
Next Scan 2024-11-22T05:43:42+00:00

Last Scan

Scanned2024-10-23T05:43:42+00:00
URL https://h1b.biz/robots.txt
Redirect https://www.h1b.biz/robots.txt
Redirect Domain www.h1b.biz
Redirect Base h1b.biz
Domain IPs 13.33.88.113, 13.33.88.25, 13.33.88.3, 13.33.88.6
Redirect IPs 13.35.185.108, 13.35.185.16, 13.35.185.46, 13.35.185.53
Response IP 13.33.88.3
Found Yes
Hash 63a431abc02e68cff5513a54dcd392080ed5141550944f351212627cac66a14d
SimHash 0015d2728f93

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/*
Disallow /captcha/*
Allow /
Back to top

Other Records

Field Value
sitemap https://www.h1b.biz/geositemap.xml
sitemap https://www.h1b.biz/sitemap.xml
Back to top