Log In Sign Up

thatware.co
robots.txt

Robots Exclusion Standard data for thatware.co

Resource Scan

Scan Details

Site Domain thatware.co
Base Domain thatware.co
Scan Status Ok
Last Scan2025-11-20T04:24:54+00:00
Next Scan 2025-12-20T04:24:54+00:00

Last Scan

Scanned2025-11-20T04:24:54+00:00
URL https://thatware.co/robots.txt
Domain IPs 192.124.249.168
Response IP 192.124.249.168
Found Yes
Hash 88650d0dda3fcea86adf3edd277564821f4ac1dc72106126ad9b4f79b2aaf897
SimHash 6010d421e4a3

Groups

*
googlebot
googlebot-mobile
googlebot-image
googlebot-news
googlebot-video

Rule Path
Allow /
Disallow /category
Allow /wp-admin/admin-ajax.php
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.png$
Allow /*.jpeg$
Allow /*.gif$
Disallow /*?=
Disallow /author/
Disallow /work_genre/
Disallow /plus-mega-menu
Disallow */page/
Disallow /refund-cancellation-policy
Disallow /basecamp
Disallow /career/
Disallow */deep-crawl/?unapproved=
Disallow */?utm_source=

chatgpt

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

chatgpt-user

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

oai-search

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bard

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

gemini

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

oai-searchbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

openai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

generativeai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

predictiveai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /
Disallow /category
Allow /wp-admin/admin-ajax.php
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.png$
Allow /*.jpeg$
Allow /*.gif$
Disallow /*?=
Disallow /author/
Disallow /work_genre/
Disallow /plus-mega-menu
Disallow */page/
Disallow /refund-cancellation-policy
Disallow /career/
Disallow /basecamp
Disallow */deep-crawl/?unapproved=
Disallow */?utm_source=

Other Records

Field Value
crawl-delay 15

baiduspider

Rule Path
Allow /
Disallow /category
Allow /wp-admin/admin-ajax.php
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.png$
Allow /*.jpeg$
Allow /*.gif$
Disallow /*?=
Disallow /author/
Disallow /work_genre/
Disallow /plus-mega-menu
Disallow */page/
Disallow /refund-cancellation-policy
Disallow /career/
Disallow /basecamp
Disallow */deep-crawl/?unapproved=
Disallow */?utm_source=

Other Records

Field Value
crawl-delay 30

yandexbot

Rule Path
Allow /
Disallow /category
Allow /wp-admin/admin-ajax.php
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.png$
Allow /*.jpeg$
Allow /*.gif$
Disallow /*?=
Disallow /author/
Disallow /work_genre/
Disallow /plus-mega-menu
Disallow */page/
Disallow /refund-cancellation-policy
Disallow /career/
Disallow /basecamp
Disallow */deep-crawl/?unapproved=
Disallow */?utm_source=

Other Records

Field Value
crawl-delay 28

duckduckbot

Rule Path
Allow /
Disallow /category
Allow /wp-admin/admin-ajax.php
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.png$
Allow /*.jpeg$
Allow /*.gif$
Disallow /*?=
Disallow /author/
Disallow /work_genre/
Disallow /plus-mega-menu
Disallow */page/
Disallow /refund-cancellation-policy
Disallow /career/
Disallow /basecamp
Disallow */deep-crawl/?unapproved=
Disallow */?utm_source=

Other Records

Field Value
crawl-delay 29

slurp

Rule Path
Allow /
Disallow /category
Allow /wp-admin/admin-ajax.php
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.png$
Allow /*.jpeg$
Allow /*.gif$
Disallow /*?=
Disallow /author/
Disallow /work_genre/
Disallow /plus-mega-menu
Disallow */page/
Disallow /refund-cancellation-policy
Disallow /career/
Disallow /basecamp
Disallow */deep-crawl/?unapproved=
Disallow */?utm_source=

Other Records

Field Value
crawl-delay 20

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

facebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

linkedinbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

pinterestbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

instagram

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Allow /
Disallow /category
Allow /wp-admin/admin-ajax.php
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.png$
Allow /*.jpeg$
Allow /*.gif$
Disallow /*?=
Disallow /author/
Disallow /work_genre/
Disallow /plus-mega-menu
Disallow */page/
Disallow /refund-cancellation-policy
Disallow /career/
Disallow /basecamp
Disallow */deep-crawl/?unapproved=
Disallow */?utm_source=

Other Records

Field Value
crawl-delay 24

applebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 17

alexacrawler

Rule Path
Allow /

Other Records

Field Value
crawl-delay 40
Back to top

Other Records

Field Value
sitemap https://thatware.co/sitemap.xml
sitemap https://thatware.co/sitemap-misc.xml
sitemap https://thatware.co/post-sitemap.xml
sitemap https://thatware.co/post-sitemap2.xml
sitemap https://thatware.co/page-sitemap.xml
Back to top

Comments

  • Allow AI and generative bots
  • Allow all other search engines
  • Allow social media crawlers
  • Allow Apple and Amazon bots
  • .-=-: .::---=---::.
  • -#####+ .-+*###############*+-.
  • :+++- -#######*+=====+*##########*:
  • .++===*###+-. :=*#######*.
  • =#######+: :=+*######*+=-. .=#######-
  • .*######=. -*################*=. =###+-.
  • .######*. =######################+. .:
  • *#####+ .*#######=-. .-=*#######=
  • +#####* :######*: .+* .+######+
  • .######. ######= - *##- -######-
  • -#####+ =#####+ ..#+-+-.: -#####*
  • =#####= *#####: .#--*=*#*. ######.
  • =#####= *#####- =.##- :--= ######.
  • :#####* =#####* =#+:==###+. =#####*
  • - ######+ :##::--=- -######:
  • :#####= .#######- .:+++=: :*######=
  • -=-. .*#######+-:....:-+########-
  • -*#####################=
  • :+################*-
  • .-=+**###*++-: :....
  • - ==.:.
  • .::.::
  • :-------: --. .--. -=- --------.--: --. .-- -== ------: .------- .
  • -==###==-.##- :##: =###+ ==+##+==.=##. +##* *#+ -###* .##*==*#* -##+====
  • *#* .##*++*##: -##:##= .##: *#+-##*#==## :##:*#+ .##=::+## -##++++-
  • *#* .##=--=##: :##*+*##: .##: .####::####: .###+*##= .##**##+. -##-:::.
  • *#* .##- :##:.##+:::+##. .##: =##+ =##+ *#+:::-##:.##= -##= -#######.
  • ... .. .. ... ... .. .. .. .. ... .. .. .......
Back to top