Log In Sign Up

studiobookr.com
robots.txt

Robots Exclusion Standard data for studiobookr.com

Resource Scan

Scan Details

Site Domain studiobookr.com
Base Domain studiobookr.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-31T16:49:07+00:00
Next Scan 2025-05-30T16:49:07+00:00

Last Successful Scan

Scanned2025-01-08T16:47:27+00:00
URL https://studiobookr.com/robots.txt
Redirect https://www.studiobookr.com/robots.txt
Redirect Domain www.studiobookr.com
Redirect Base studiobookr.com
Domain IPs 104.26.4.209, 104.26.5.209, 172.67.72.151, 2606:4700:20::681a:4d1, 2606:4700:20::681a:5d1, 2606:4700:20::ac43:4897
Redirect IPs 104.26.4.209, 104.26.5.209, 172.67.72.151, 2606:4700:20::681a:4d1, 2606:4700:20::681a:5d1, 2606:4700:20::ac43:4897
Response IP 104.26.5.209
Found Yes
Hash 7d7aacbd80415a1eca7d4f9c6a242a47af38ea39f926141ea36943dac5b5f952
SimHash 684d5088ef08

Groups

*

Rule Path
Disallow /WebService.asmx/
Disallow /version.html

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

oai-searchbot
chatgpt-user
gptbot

Rule Path
Disallow /searchresults/*
Back to top

Comments

  • BLEXBot blocked due intensive crawling of non-existing URLs in Jan '17
  • http://webmeup-crawler.com/
  • SemrushBot blocked due too intensive crawling in May '20
  • Blocked due to crawling once per minute of this non-exsiting url in April 2023
  • https://www.studiobookr.com/schoenmacherei-aesthetik-institut-58479/Willkommen/Produkte/Beauty-Blog/index.php/;session=9433dd7f4adb1a2671ce4f6096dd89a2&focus=STRATP_com_cm4all_wdn_Flatpress_10917523&path=?x=y:19%3Bm:07
  • 2024-07-11, RA+CK
  • Temporarily blocked due too intensive crawling in Nov '24
Back to top