fabulatech.com
robots.txt

Robots Exclusion Standard data for fabulatech.com

Resource Scan

Scan Details

Site Domain fabulatech.com
Base Domain fabulatech.com
Scan Status Ok
Last Scan2025-09-23T01:56:31+00:00
Next Scan 2025-10-23T01:56:31+00:00

Last Scan

Scanned2025-09-23T01:56:31+00:00
URL https://fabulatech.com/robots.txt
Redirect https://www.fabulatech.com/robots.txt
Redirect Domain www.fabulatech.com
Redirect Base fabulatech.com
Domain IPs 74.84.144.110
Redirect IPs 74.84.144.110
Response IP 74.84.144.110
Found Yes
Hash 962ea1118bcc4d661d7e7ab26c426b949ad37f937080cb36495594611ba474c3
SimHash 790c89724383

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /chat/
Disallow *action-viewprofile*
Disallow *action-login*
Disallow *action-modify*
Disallow *action-post*
Disallow *action-search*
Disallow *action-register*
Disallow *action-notify*
Disallow *action-print*

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fabulatech.com/sitemap.xml

Comments

  • Disallow: /rss/