tamatem.akhtaboot.com
robots.txt

Robots Exclusion Standard data for tamatem.akhtaboot.com

Resource Scan

Scan Details

Site Domain tamatem.akhtaboot.com
Base Domain akhtaboot.com
Scan Status Ok
Last Scan2024-11-09T05:52:39+00:00
Next Scan 2024-11-23T05:52:39+00:00

Last Scan

Scanned2024-11-09T05:52:39+00:00
URL https://tamatem.akhtaboot.com/robots.txt
Domain IPs 164.92.215.232
Response IP 164.92.215.232
Found Yes
Hash d0b42049416a30e02d04b120b1ee6722d619ef6c96cca558f632324525bab871
SimHash 6815f7024291

Groups

ahrefsbot

Rule Path
Disallow

ahrefssiteaudit

Rule Path
Disallow

jooblebot

Rule Path
Allow /

googlebot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

applebot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

bingbot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

msnbot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

slurp

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

googlebot-image

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

baiduspider

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

seznambot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

teoma

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

yandex

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

yeti

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

msnbot-media

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

googlebot-news

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

googlebot-video

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

googlebot-mobile

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

mediapartners-google

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

adsbot-google

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

duckduckbot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

daumoa

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

orangebot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

orangebot-collector

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

stackrambler

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

twitterbot/1.0

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

mail.ru_bot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

naverbot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

vebidoobot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

mj12bot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

sogou

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

rogerbot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

deepcrawl

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

cincobot

Rule Path
Allow *

Other Records

Field Value
crawl-delay 15

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://akhtaboot.com/sitemap.xml.gz

Warnings

  • 3 invalid lines.