devjobs.asia
robots.txt

Robots Exclusion Standard data for devjobs.asia

Resource Scan

Scan Details

Site Domain devjobs.asia
Base Domain devjobs.asia
Scan Status Ok
Last Scan2024-10-31T12:43:42+00:00
Next Scan 2024-11-07T12:43:42+00:00

Last Scan

Scanned2024-10-31T12:43:42+00:00
URL https://devjobs.asia/robots.txt
Redirect https://www.devjobs.asia/robots.txt
Redirect Domain www.devjobs.asia
Redirect Base devjobs.asia
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 2404:6800:4003:c0f::79, 74.125.130.121
Response IP 142.251.12.121
Found Yes
Hash 93d70e15afbfac6b524a0a5bae342c97a7c67a586bc6cae740bdaad9433a84c9
SimHash 29049260c613

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.devjobs.asia/sitemap.xml