syntheticgems.org
robots.txt

Robots Exclusion Standard data for syntheticgems.org

Resource Scan

Scan Details

Site Domain syntheticgems.org
Base Domain syntheticgems.org
Scan Status Ok
Last Scan2025-10-31T01:43:15+00:00
Next Scan 2025-11-30T01:43:15+00:00

Last Scan

Scanned2025-10-31T01:43:15+00:00
URL https://syntheticgems.org/robots.txt
Domain IPs 148.72.90.21
Response IP 148.72.90.21
Found Yes
Hash fd71b6f5b10641a63dd04054469d458fd4630c5efde50297276a53f564efce8e
SimHash 183c8d60ea33

Groups

*

Rule Path
Disallow /webadmin/

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

xenu’s link sleuth 1.1c

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.syntheticgems.org/sitemap.xml