hbomaxwatchparty.us
robots.txt

Robots Exclusion Standard data for hbomaxwatchparty.us

Resource Scan

Scan Details

Site Domain hbomaxwatchparty.us
Base Domain hbomaxwatchparty.us
Scan Status Ok
Last Scan2024-05-25T12:15:55+00:00
Next Scan 2024-06-24T12:15:55+00:00

Last Scan

Scanned2024-05-25T12:15:55+00:00
URL https://hbomaxwatchparty.us/robots.txt
Redirect https://www.hbomaxwatchparty.us/robots.txt
Redirect Domain www.hbomaxwatchparty.us
Redirect Base hbomaxwatchparty.us
Domain IPs 104.21.14.118, 172.67.133.194, 2606:4700:3033::6815:e76, 2606:4700:3034::ac43:85c2
Redirect IPs 104.21.14.118, 172.67.133.194, 2606:4700:3033::6815:e76, 2606:4700:3034::ac43:85c2
Response IP 172.67.133.194
Found Yes
Hash 49fd2c5968f3ac598729157608474267be59e87961650955518ffa99dad010a4
SimHash 4c749d7a3747

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /googlebot/

Comments

  • Allow all user agents.
  • User agent "Googlebot" should not crawl the `http://example.com/nogooglebot/` folder or any of its subdirectories.