disneyplusparty.us
robots.txt

Robots Exclusion Standard data for disneyplusparty.us

Resource Scan

Scan Details

Site Domain disneyplusparty.us
Base Domain disneyplusparty.us
Scan Status Ok
Last Scan2024-05-27T23:05:30+00:00
Next Scan 2024-06-26T23:05:30+00:00

Last Scan

Scanned2024-05-27T23:05:30+00:00
URL https://disneyplusparty.us/robots.txt
Redirect https://www.disneyplusparty.us/robots.txt
Redirect Domain www.disneyplusparty.us
Redirect Base disneyplusparty.us
Domain IPs 104.21.67.194, 172.67.180.34, 2606:4700:3030::6815:43c2, 2606:4700:3031::ac43:b422
Redirect IPs 104.21.67.194, 172.67.180.34, 2606:4700:3030::6815:43c2, 2606:4700:3031::ac43:b422
Response IP 104.21.67.194
Found Yes
Hash 49fd2c5968f3ac598729157608474267be59e87961650955518ffa99dad010a4
SimHash 4c749d7a3747

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /googlebot/

Comments

  • Allow all user agents.
  • User agent "Googlebot" should not crawl the `http://example.com/nogooglebot/` folder or any of its subdirectories.