Log In Sign Up

globalworkandtravel.com
robots.txt

Robots Exclusion Standard data for globalworkandtravel.com

Resource Scan

Scan Details

Site Domain globalworkandtravel.com
Base Domain globalworkandtravel.com
Scan Status Ok
Last Scan2024-09-11T03:24:16+00:00
Next Scan 2024-10-11T03:24:16+00:00

Last Scan

Scanned2024-09-11T03:24:16+00:00
URL https://globalworkandtravel.com/robots.txt
Redirect https://www.globalworkandtravel.com/robots.txt
Redirect Domain www.globalworkandtravel.com
Redirect Base globalworkandtravel.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.123, 76.76.21.9
Response IP 76.76.21.241
Found Yes
Hash 67693a7c3dc84d6f6755cf8830f76cbabf5d768a0f67b69f7c9b48eb45962732
SimHash 61c0fb0144b5

Groups

*

Rule Path
Allow /
Disallow /*?utm_
Disallow /*%26utm_
Disallow /*?affiliate_id
Disallow /*%26affiliate_id
Disallow /*?link_id
Disallow /*%26link_id
Disallow /*?ref
Disallow /*%26ref
Disallow /*?ads_
Disallow /*%26ads_
Disallow /*?gclid
Disallow /*%26gclid

googlebot

Rule Path
Disallow /*.svg$

adsbot-google

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.globalworkandtravel.com/sitemap.xml
Back to top

Comments

  • Sitemap location
  • General rules for all crawlers
  • Block .svg files from being indexed in google images
  • Allow all for AdsBot-Google
Back to top