rachitnigam.com
robots.txt

Robots Exclusion Standard data for rachitnigam.com

Resource Scan

Scan Details

Site Domain rachitnigam.com
Base Domain rachitnigam.com
Scan Status Ok
Last Scan2025-10-13T07:50:50+00:00
Next Scan 2025-11-12T07:50:50+00:00

Last Scan

Scanned2025-10-13T07:50:50+00:00
URL https://rachitnigam.com/robots.txt
Redirect https://people.csail.mit.edu/rachit/robots.txt
Redirect Domain people.csail.mit.edu
Redirect Base mit.edu
Domain IPs 104.21.65.175, 172.67.164.244, 2606:4700:3033::6815:41af, 2606:4700:3036::ac43:a4f4
Redirect IPs 128.52.131.233
Response IP 128.52.131.233
Found Yes
Hash 23576b9afa04db61e8c294caf31775ddcc3f3907b5f40a0fe990d6fc3d4cd1b3
SimHash 0904d810c313

Groups

*

Rule Path
Disallow
Allow /

Other Records

Field Value
sitemap https://people.csail.mit.edu/rachit/sitemap.xml