lookfordiagnosis.com
robots.txt

Robots Exclusion Standard data for lookfordiagnosis.com

Resource Scan

Scan Details

Site Domain lookfordiagnosis.com
Base Domain lookfordiagnosis.com
Scan Status Ok
Last Scan2024-06-28T04:26:53+00:00
Next Scan 2024-07-05T04:26:53+00:00

Last Scan

Scanned2024-06-28T04:26:53+00:00
URL https://lookfordiagnosis.com/robots.txt
Domain IPs 104.21.39.224, 172.67.149.96, 2606:4700:3030::ac43:9560, 2606:4700:3036::6815:27e0
Response IP 172.67.149.96
Found Yes
Hash 02e1753f0c4999551a509bf42939d98da49499de98520f2b593aa8e21d01ab36
SimHash 2075c240f698

Groups

spiderling

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegel

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

*

Rule Path
Disallow /search.php*
Disallow /images.php*from%3D*
Disallow /images.php*from2%3D*
Disallow /images.php*from3%3D*
Disallow /videos.php*from%3D*
Disallow /videos.php*title%3D*

Other Records

Field Value
sitemap http://www.lookfordiagnosis.com/sitemaps/sitemaps_index.xml

Comments

  • Disallow: /results.php*
  • GOOGLE IMAGES
  • BING IMAGES
  • FLICKR IMAGES
  • VIDEOS
  • SITEMAPS