theoutbound.com
robots.txt

Robots Exclusion Standard data for theoutbound.com

Resource Scan

Scan Details

Site Domain theoutbound.com
Base Domain theoutbound.com
Scan Status Ok
Last Scan2024-11-09T18:09:58+00:00
Next Scan 2024-11-16T18:09:58+00:00

Last Scan

Scanned2024-11-09T18:09:58+00:00
URL https://theoutbound.com/robots.txt
Redirect https://www.theoutbound.com/robots.txt
Redirect Domain www.theoutbound.com
Redirect Base theoutbound.com
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 7eadcab42cf021563d12a01a400086811198419b02e11b1ae647e119800a3106
SimHash 794dc8516d13

Groups

*

Rule Path
Allow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

brandseye

Rule Path
Disallow /

diffbot

Rule Path
Disallow /
Allow /how-it-works
Allow /our-story
Allow /giving-back
Allow /meet-the-team
Allow /our-photography
Allow /house-rules
Allow /users/sign_in
Allow /users/sign_up
Allow /assets/
Disallow /users
Disallow /users/*
Disallow /my_stuff/*

Other Records

Field Value
sitemap https://www.theoutbound.com/sitemap.xml
sitemap https://www.theoutbound.com/sitemaps/site.xml
sitemap https://www.theoutbound.com/sitemaps/destinations.xml
sitemap https://www.theoutbound.com/sitemaps/activities.xml
sitemap https://www.theoutbound.com/sitemaps/adventures.xml