blogthislink.com
robots.txt

Robots Exclusion Standard data for blogthislink.com

Resource Scan

Scan Details

Site Domain blogthislink.com
Base Domain blogthislink.com
Scan Status Ok
Last Scan2024-10-04T18:56:48+00:00
Next Scan 2024-10-11T18:56:48+00:00

Last Scan

Scanned2024-10-04T18:56:48+00:00
URL https://blogthislink.com/robots.txt
Redirect https://www.blogthislink.com/robots.txt
Redirect Domain www.blogthislink.com
Redirect Base blogthislink.com
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.12.121, 2404:6800:4003:c1c::79
Response IP 74.125.200.121
Found Yes
Hash 1c363adf3b35ae9f24833074135b6fe5902b990878bf696c7141c81ef1ce6bca
SimHash 68615b925287

Groups

*

Rule Path
Disallow

robots

Rule Path
Disallow

applebot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

baiduspider-image

Rule Path
Disallow

baiduspider-video

Rule Path
Disallow

bingbot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

exabot

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

msnbot

Rule Path
Disallow

msnbot-media

Rule Path
Disallow

naverbot

Rule Path
Disallow

seznambot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

twitterbot

Rule Path
Disallow

yandex

Rule Path
Disallow

yeti

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.blogthislink.com/sitemap.xml
sitemap https://www.blogthislink.com/sitemap-pages.xml
sitemap https://www.blogthislink.com/feeds/posts/default
sitemap https://www.blogthislink.com/feeds/posts/default?alt=rss
sitemap https://www.blogthislink.com/rss.xml
sitemap https://www.blogthislink.com/feeds/posts/full
sitemap https://www.blogthislink.com/atom.xml
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=1&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=101&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=201&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=301&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=401&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=501&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=601&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=701&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=801&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=901&max-results=100
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*0)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*1)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*2)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*3)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*4)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*5)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*6)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*7)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*8)+1&max-results=m
sitemap https://www.blogthislink.com/atom.xml?redirect=false&start-index=(m*9)+1&max-results=m

Comments

  • Updated April 2, 2020
  • https://www.blogthislink.com/