madhujobs.com
robots.txt

Robots Exclusion Standard data for madhujobs.com

Resource Scan

Scan Details

Site Domain madhujobs.com
Base Domain madhujobs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-27T08:16:53+00:00
Next Scan 2025-05-11T08:16:53+00:00

Last Successful Scan

Scanned2025-04-12T07:01:57+00:00
URL https://madhujobs.com/robots.txt
Redirect https://www.madhujobs.com/robots.txt
Redirect Domain www.madhujobs.com
Redirect Base madhujobs.com
Domain IPs 104.21.54.228, 172.67.143.29, 2606:4700:3030::6815:36e4, 2606:4700:3033::ac43:8f1d
Redirect IPs 104.21.54.228, 172.67.143.29, 2606:4700:3030::6815:36e4, 2606:4700:3033::ac43:8f1d
Response IP 104.21.54.228
Found Yes
Hash b8e1811de5e1961906328c8c5979c9f82c4613613cdd21578a22ac9b93e6c531
SimHash 6101c8008b92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.madhujobs.com/sitemap_index.xml