gopetition.com
robots.txt

Robots Exclusion Standard data for gopetition.com

Resource Scan

Scan Details

Site Domain gopetition.com
Base Domain gopetition.com
Scan Status Ok
Last Scan2024-09-24T23:37:42+00:00
Next Scan 2024-09-25T23:37:42+00:00

Last Scan

Scanned2024-09-24T23:37:42+00:00
URL https://gopetition.com/robots.txt
Redirect https://www.gopetition.com/robots.txt
Redirect Domain www.gopetition.com
Redirect Base gopetition.com
Domain IPs 104.21.59.115, 172.67.175.161, 2606:4700:3032::6815:3b73, 2606:4700:3037::ac43:afa1
Redirect IPs 104.21.59.115, 172.67.175.161, 2606:4700:3032::6815:3b73, 2606:4700:3037::ac43:afa1
Response IP 104.21.59.115
Found Yes
Hash 563571de0a457c654a988d809fdaca7e2f76757d0ca17eb3b62a73ed40fb0abb
SimHash a93a2cf2e2b3

Groups

ahrefsbot

Rule Path
Disallow /pushers/
Disallow /contact/author/
Disallow /banners/
Disallow /signature/comment/

Other Records

Field Value
crawl-delay 20

Warnings

  • 1 invalid line.