tusaludmag.com
robots.txt

Robots Exclusion Standard data for tusaludmag.com

Resource Scan

Scan Details

Site Domain tusaludmag.com
Base Domain tusaludmag.com
Scan Status Ok
Last Scan2024-11-10T01:22:03+00:00
Next Scan 2024-11-17T01:22:03+00:00

Last Scan

Scanned2024-11-10T01:22:03+00:00
URL https://tusaludmag.com/robots.txt
Redirect https://www.tusaludmag.com/robots.txt
Redirect Domain www.tusaludmag.com
Redirect Base tusaludmag.com
Domain IPs 3.215.112.53, 52.45.87.85
Redirect IPs 3.215.112.53, 52.45.87.85
Response IP 52.45.87.85
Found Yes
Hash 7bb688d194fa8e11a2ca5b31d7ce4b62f024b9f9b2ea2ec26aeda7eb060a072d
SimHash 6b4f5851ccb0

Groups

*

Rule Path
Disallow */get-pdf

Other Records

Field Value
crawl-delay 12

mj12bot
seekportbot

Rule Path
Disallow */get-pdf

Other Records

Field Value
crawl-delay 20

awariorssbot
awariosmartbot
blexbot
dataforseobot
dotbot
panscient.com
petalbot
turnitinbot

Rule Path
Disallow */get-pdf

Other Records

Field Value
crawl-delay 16

ahrefsbot
ccbot
claudebot
daum
friendlycrawler
gptbot
hawaiibot
linkedinbot
megaindex.com
megaindex.ru
netestate
netestate%20ne%20crawler
panscient.com
seokicks
seokicks-robot
serpstatbot
treato-bot

Rule Path
Disallow */get-pdf

Other Records

Field Value
crawl-delay 14

bingbot
slurp

Rule Path
Disallow */get-pdf

Other Records

Field Value
crawl-delay 8

Other Records

Field Value
sitemap https://www.tusaludmag.com/sitemap.xml

Comments

  • automation managed
  • block get-pdf
  • default 10 sec delay
  • 20 sec delay
  • 16 sec delay
  • 14 sec delay
  • 8 sec delay