parsget.com
robots.txt

Robots Exclusion Standard data for parsget.com

Resource Scan

Scan Details

Site Domain parsget.com
Base Domain parsget.com
Scan Status Ok
Last Scan2025-10-11T16:32:12+00:00
Next Scan 2025-11-10T16:32:12+00:00

Last Scan

Scanned2025-10-11T16:32:12+00:00
URL https://parsget.com/robots.txt
Domain IPs 104.21.54.77, 172.67.136.195, 2606:4700:3030::ac43:88c3, 2606:4700:3031::6815:364d
Response IP 104.21.54.77
Found Yes
Hash cfdaba7cd4d8e245a63c88e692640e7c518c193991e761e292fd3f0edf27c0f3
SimHash 090d7df2a512

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /_next/
Disallow /static/
Allow /pages/
Allow /pages/supported-hosts
Allow /pages/contact-us
Allow /pages/faq
Allow /pages/tos

Other Records

Field Value
sitemap https://parsget.com/sitemap.xml

Comments

  • Disallow admin and internal paths
  • Allow important pages