codementor.io
robots.txt

Robots Exclusion Standard data for codementor.io

Resource Scan

Scan Details

Site Domain codementor.io
Base Domain codementor.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-24T12:05:57+00:00
Next Scan 2024-10-22T12:05:57+00:00

Last Successful Scan

Scanned2023-06-07T17:37:01+00:00
URL https://codementor.io/robots.txt
Redirect https://www.codementor.io/robots.txt
Redirect Domain www.codementor.io
Redirect Base codementor.io
Domain IPs 34.201.80.84, 54.157.4.65, 54.196.16.164, 54.91.6.89
Redirect IPs 2600:9000:2003:1600:15:7e1a:cc0:93a1, 2600:9000:2003:200:15:7e1a:cc0:93a1, 2600:9000:2003:2600:15:7e1a:cc0:93a1, 2600:9000:2003:6c00:15:7e1a:cc0:93a1, 2600:9000:2003:7a00:15:7e1a:cc0:93a1, 2600:9000:2003:8000:15:7e1a:cc0:93a1, 2600:9000:2003:9000:15:7e1a:cc0:93a1, 2600:9000:2003:ec00:15:7e1a:cc0:93a1, 54.192.150.114, 54.192.150.69, 54.192.150.77, 54.192.150.82
Response IP 52.222.236.21
Found Yes
Hash c996fa0fbaecb3cc695e3c5fa327fe97f762640c78d9866dc4ba0470adffdae1
SimHash 4100c151c733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.codementor.io/sitemap.xml