company-pages.us
robots.txt

Robots Exclusion Standard data for company-pages.us

Resource Scan

Scan Details

Site Domain company-pages.us
Base Domain company-pages.us
Scan Status Ok
Last Scan2024-09-28T06:23:31+00:00
Next Scan 2024-10-05T06:23:31+00:00

Last Scan

Scanned2024-09-28T06:23:31+00:00
URL https://company-pages.us/robots.txt
Redirect https://pixeldoctors.at/robots.txt
Redirect Domain pixeldoctors.at
Redirect Base pixeldoctors.at
Domain IPs 104.21.6.111, 172.67.134.192, 2606:4700:3030::6815:66f, 2606:4700:3031::ac43:86c0
Redirect IPs 104.21.55.192, 172.67.172.108, 2606:4700:3034::6815:37c0, 2606:4700:3034::ac43:ac6c
Response IP 172.67.172.108
Found Yes
Hash c43f16add61e667cc98a3fc95f1368cfe9103adc95f43e1c88ace3837e09db62
SimHash 61304b3265b2

Groups

*

Rule Path
Disallow /*/add-review
Disallow /*/edit

Comments

  • www.robotstxt.org/
  • Allow crawling of all content