bhumi.ngo
robots.txt

Robots Exclusion Standard data for bhumi.ngo

Resource Scan

Scan Details

Site Domain bhumi.ngo
Base Domain bhumi.ngo
Scan Status Ok
Last Scan2024-09-22T21:02:44+00:00
Next Scan 2024-10-22T21:02:44+00:00

Last Scan

Scanned2024-09-22T21:02:44+00:00
URL https://bhumi.ngo/robots.txt
Redirect https://www.bhumi.ngo/robots.txt
Redirect Domain www.bhumi.ngo
Redirect Base bhumi.ngo
Domain IPs 13.33.88.41, 13.33.88.72, 13.33.88.84, 13.33.88.96, 2600:9000:223b:1800:7:4a99:3640:93a1, 2600:9000:223b:3200:7:4a99:3640:93a1, 2600:9000:223b:3c00:7:4a99:3640:93a1, 2600:9000:223b:5400:7:4a99:3640:93a1, 2600:9000:223b:8e00:7:4a99:3640:93a1, 2600:9000:223b:9e00:7:4a99:3640:93a1, 2600:9000:223b:a400:7:4a99:3640:93a1, 2600:9000:223b:c800:7:4a99:3640:93a1
Redirect IPs 13.33.88.41, 13.33.88.72, 13.33.88.84, 13.33.88.96, 2600:9000:223b:2200:7:4a99:3640:93a1, 2600:9000:223b:6800:7:4a99:3640:93a1, 2600:9000:223b:7200:7:4a99:3640:93a1, 2600:9000:223b:9800:7:4a99:3640:93a1, 2600:9000:223b:a200:7:4a99:3640:93a1, 2600:9000:223b:c000:7:4a99:3640:93a1, 2600:9000:223b:cc00:7:4a99:3640:93a1, 2600:9000:223b:d800:7:4a99:3640:93a1
Response IP 13.33.88.72
Found Yes
Hash c41be7606fb46b3e8d3c695a5935810b8ac94e43dd2cedcd3b44be8c28cf90b6
SimHash 4d10df146f13

Groups

*

Rule Path
Disallow /api/

*

Rule Path
Allow /

Other Records

Field Value
sitemap bhumi.ngo/sitemap.xml

Comments

  • Allow all crawlers