jealousfork.com
robots.txt

Robots Exclusion Standard data for jealousfork.com

Resource Scan

Scan Details

Site Domain jealousfork.com
Base Domain jealousfork.com
Scan Status Ok
Last Scan2025-10-04T15:48:37+00:00
Next Scan 2025-11-03T15:48:37+00:00

Last Scan

Scanned2025-10-04T15:48:37+00:00
URL https://jealousfork.com/robots.txt
Domain IPs 34.111.179.208
Response IP 34.111.179.208
Found Yes
Hash edb56b51d3eab89f4721bc28f4be7b119b83f68bdf12a1559d689f0fe0803ac6
SimHash e280d251c8a3

Groups

*

Rule Path
Allow /
Allow /full-menu
Allow /near/

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://jealousfork.com/sitemap.xml

Comments

  • Priority pages for crawling
  • Social media and review platforms
  • Sitemap location
  • Crawl delay for respectful crawling