markporter.com
robots.txt

Robots Exclusion Standard data for markporter.com

Resource Scan

Scan Details

Site Domain markporter.com
Base Domain markporter.com
Scan Status Ok
Last Scan2024-06-07T20:28:00+00:00
Next Scan 2024-06-14T20:28:00+00:00

Last Scan

Scanned2024-06-07T20:28:00+00:00
URL https://markporter.com/robots.txt
Domain IPs 104.21.19.230, 172.67.190.115, 2606:4700:3032::ac43:be73, 2606:4700:3037::6815:13e6
Response IP 172.67.190.115
Found Yes
Hash e05949d2fb5f5f866e78bba102468e86b1a7b053b68a8659961d609c0f4f4429
SimHash c17819523713

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://markporter.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://markporter.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/