sporked.com
robots.txt

Robots Exclusion Standard data for sporked.com

Resource Scan

Scan Details

Site Domain sporked.com
Base Domain sporked.com
Scan Status Ok
Last Scan2024-09-18T10:46:24+00:00
Next Scan 2024-09-25T10:46:24+00:00

Last Scan

Scanned2024-09-18T10:46:24+00:00
URL https://sporked.com/robots.txt
Domain IPs 104.19.154.92
Response IP 104.19.154.92
Found Yes
Hash 4077690d6b5a853401d9e490f74e211344b63120ab116ec5e4f349dd78661d35
SimHash 284c09506c53

Groups

*

Rule Path
Disallow
Disallow /*/feed/
Allow /feed/atom/

Other Records

Field Value
sitemap https://sporked.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Sitemap files
  • ---------------------------
  • END YOAST BLOCK
  • Block crawling of feeds, except Atom