mployee.me
robots.txt

Robots Exclusion Standard data for mployee.me

Resource Scan

Scan Details

Site Domain mployee.me
Base Domain mployee.me
Scan Status Ok
Last Scan2024-06-03T23:24:11+00:00
Next Scan 2024-07-03T23:24:11+00:00

Last Scan

Scanned2024-06-03T23:24:11+00:00
URL https://mployee.me/robots.txt
Redirect https://www.mployee.me/robots.txt
Redirect Domain www.mployee.me
Redirect Base mployee.me
Domain IPs 13.227.254.103, 13.227.254.42, 13.227.254.68, 13.227.254.74
Redirect IPs 13.227.254.103, 13.227.254.42, 13.227.254.68, 13.227.254.74, 2600:9000:200a:3200:14:4500:f680:93a1, 2600:9000:200a:3c00:14:4500:f680:93a1, 2600:9000:200a:5600:14:4500:f680:93a1, 2600:9000:200a:5c00:14:4500:f680:93a1, 2600:9000:200a:b800:14:4500:f680:93a1, 2600:9000:200a:e200:14:4500:f680:93a1, 2600:9000:200a:e400:14:4500:f680:93a1, 2600:9000:200a:fa00:14:4500:f680:93a1
Response IP 13.227.254.103
Found Yes
Hash 5cc49fc39a7f70ea3b0c54177819db886dfd75f6de4fd38b405863a43e13a986
SimHash 4d50ce60c312

Groups

*

Rule Path
Allow /
Disallow
Disallow /cgi-bin/
Disallow /bulk-resume-check
Disallow /JobRecommendation
Disallow /resume-bullet-check-excel
Disallow /resume-bullet-check
Disallow /interview-preparation
Disallow /interview-questions
Disallow /mentorship
Disallow /page2
Disallow /job-recommendation

Other Records

Field Value
sitemap https://www.mployee.me/sitemap.xml

Comments

  • Allow all crawlers