femisheaven.com
robots.txt

Robots Exclusion Standard data for femisheaven.com

Resource Scan

Scan Details

Site Domain femisheaven.com
Base Domain femisheaven.com
Scan Status Ok
Last Scan2026-03-07T00:52:33+00:00
Next Scan 2026-04-06T00:52:33+00:00

Last Scan

Scanned2026-03-07T00:52:33+00:00
URL https://femisheaven.com/robots.txt
Domain IPs 104.21.84.59, 172.67.187.29, 2606:4700:3030::6815:543b, 2606:4700:3036::ac43:bb1d
Response IP 172.67.187.29
Found Yes
Hash b678568f28e742cd1f949f3621f0d1cc39d3cd6ee8936a89c84b1462dc43ffab
SimHash 6d10db906526

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /_next/
Disallow /user/
Disallow /checkout/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap http://femisheaven.com/sitemap.xml

Comments

  • Robots.txt for http://femisheaven.com
  • Allow all crawlers
  • Allow crawling of all content
  • Disallow admin and private areas
  • Sitemap location
  • Crawl delay (optional)