Log In Sign Up

sponsorpitch.com
robots.txt

Robots Exclusion Standard data for sponsorpitch.com

Resource Scan

Scan Details

Site Domain sponsorpitch.com
Base Domain sponsorpitch.com
Scan Status Ok
Last Scan2025-04-11T10:19:56+00:00
Next Scan 2025-04-18T10:19:56+00:00

Last Scan

Scanned2025-04-11T10:19:56+00:00
URL https://sponsorpitch.com/robots.txt
Redirect https://app.sponsorpitch.com/robots.txt
Redirect Domain app.sponsorpitch.com
Redirect Base sponsorpitch.com
Domain IPs 104.21.79.133, 172.67.145.188, 2606:4700:3030::6815:4f85, 2606:4700:3030::ac43:91bc
Redirect IPs 104.21.79.133, 172.67.145.188, 2606:4700:3030::6815:4f85, 2606:4700:3030::ac43:91bc
Response IP 172.67.145.188
Found Yes
Hash 7a02e2bdfe1889daf627a446abc81c257942c9f1f5a7e6b5c39aaa517fea47f7
SimHash b28d4d857550

Groups

*

Rule Path
Disallow /auth/linkedin
Disallow /private/
Back to top

Other Records

Field Value
sitemap /sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines :
Back to top