ramhaiti.com
robots.txt

Robots Exclusion Standard data for ramhaiti.com

Resource Scan

Scan Details

Site Domain ramhaiti.com
Base Domain ramhaiti.com
Scan Status Ok
Last Scan2026-01-29T07:40:25+00:00
Next Scan 2026-02-12T07:40:25+00:00

Last Scan

Scanned2026-01-29T07:40:25+00:00
URL https://ramhaiti.com/robots.txt
Redirect https://borealisrecords.com/robots.txt
Redirect Domain borealisrecords.com
Redirect Base borealisrecords.com
Domain IPs 104.18.40.184, 172.64.147.72, 2606:4700:440a::6812:28b8, 2a06:98c1:3106::ac40:9348
Redirect IPs 104.18.24.114, 104.18.25.114, 2606:4700::6812:1872, 2606:4700::6812:1972
Response IP 104.18.24.114
Found Yes
Hash 1b741835d63e0b540f6a7dbc6494fb0432dfc2e243f264162e2b19400f7a415d
SimHash 6918d80009a2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /author/
Disallow /*/trackback
Disallow /tag/
Disallow /*/feed
Disallow /?s=*
Disallow /attachment/
Disallow /*?utm_source
Disallow /*%26utm_source

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://borealisrecords.com/sitemap.xml

Comments

  • Allow Facebook scraper