jobsthainow.com
robots.txt

Robots Exclusion Standard data for jobsthainow.com

Resource Scan

Scan Details

Site Domain jobsthainow.com
Base Domain jobsthainow.com
Scan Status Ok
Last Scan2025-12-27T04:56:01+00:00
Next Scan 2026-01-03T04:56:01+00:00

Last Scan

Scanned2025-12-27T04:56:01+00:00
URL https://jobsthainow.com/robots.txt
Domain IPs 103.30.127.7
Response IP 103.30.127.7
Found Yes
Hash 8bcda943788feee580bb07d06171deda5d7aebca8c7a9d05d4d5e999bb642ba9
SimHash 2f1893608565

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

ccbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /
Disallow /administrator/
Disallow /api/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /media/system/
Disallow /configuration.php
Disallow /htaccess.txt
Disallow /web.config.txt
Disallow /LICENSE.txt
Disallow /README.txt
Disallow /robots.txt.dist
Disallow /*?task=
Disallow /*?option=com_users
Disallow /*?view=form
Disallow /*?layout=edit
Disallow /*?tmpl=component
Disallow /*%26print%3D1
Disallow /*%26format%3Dfeed
Disallow /*%26type%3Drss
Disallow /*?format=feed
Disallow /*?type=rss
Disallow /*?types%5B0%5D=
Disallow /*?types%5B0%5D=
Disallow /*search?q=
Disallow /*?start=
Disallow /*?*utm_*
Disallow /*?*sessionid*
Disallow /*?*PHPSESSID*
Disallow /*%26*sessionid*
Disallow /*%26*PHPSESSID*
Disallow /*?*fbclid*
Disallow /*?*gclid*
Disallow /*?*ref=*

Other Records

Field Value
sitemap https://www.jobsthainow.com/component/osmap/?view=xml&id=1&format=xml
sitemap https://www.jobsthainow.com/component/osmap/?view=xml&id=1&images=1&format=xml
sitemap https://www.jobsthainow.com/component/osmap/?view=xml&id=1&news=1&format=xml

Comments

  • robots.txt for - jobsthainow.com
  • Allow major search engines and AI bots
  • Block system directories
  • Block configuration and system files
  • Block common parameters and URLs
  • Block search and filter parameters
  • Block tracking and session parameters
  • Block common unwanted parameters
  • Sitemaps