lexisjobs.asia
robots.txt

Robots Exclusion Standard data for lexisjobs.asia

Resource Scan

Scan Details

Site Domain lexisjobs.asia
Base Domain lexisjobs.asia
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-24T07:43:51+00:00
Next Scan 2024-10-08T07:43:51+00:00

Last Successful Scan

Scanned2024-08-17T05:41:16+00:00
URL https://lexisjobs.asia/robots.txt
Redirect https://www.lexisjobs.asia/robots.txt
Redirect Domain www.lexisjobs.asia
Redirect Base lexisjobs.asia
Domain IPs 104.26.14.197, 104.26.15.197, 172.67.72.76, 2606:4700:20::681a:ec5, 2606:4700:20::681a:fc5, 2606:4700:20::ac43:484c
Redirect IPs 104.26.14.197, 104.26.15.197, 172.67.72.76, 2606:4700:20::681a:ec5, 2606:4700:20::681a:fc5, 2606:4700:20::ac43:484c
Response IP 104.26.14.197
Found Yes
Hash 53460997858c24d035aeb7ceb40eb2570437cc1c0b912c7f8e2c14d566a0f8ec
SimHash 484808920593

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.lexisjobs.asia/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html