2x2pasaule.lv
robots.txt

Robots Exclusion Standard data for 2x2pasaule.lv

Resource Scan

Scan Details

Site Domain 2x2pasaule.lv
Base Domain 2x2pasaule.lv
Scan Status Ok
Last Scan2024-09-16T17:13:08+00:00
Next Scan 2024-10-16T17:13:08+00:00

Last Scan

Scanned2024-09-16T17:13:08+00:00
URL https://2x2pasaule.lv/robots.txt
Domain IPs 13.251.96.10, 52.74.166.77
Response IP 13.251.96.10
Found Yes
Hash 4caecd7804d37bd38aac5a735d7899d46d6bd2daaf7139823b5a2c77ebd77453
SimHash 4850cb024772

Groups

*

Rule Path
Allow /

Comments

  • Block all crawlers for /accounts
  • User-agent: *
  • Disallow: /accounts
  • Allow all crawlers
  • User-agent: *
  • Allow: /
  • Disallow all crawlers