dogs.ie
robots.txt

Robots Exclusion Standard data for dogs.ie

Resource Scan

Scan Details

Site Domain dogs.ie
Base Domain dogs.ie
Scan Status Ok
Last Scan2024-11-09T21:21:46+00:00
Next Scan 2024-11-16T21:21:46+00:00

Last Scan

Scanned2024-11-09T21:21:46+00:00
URL https://dogs.ie/robots.txt
Domain IPs 46.22.135.49
Response IP 46.22.135.49
Found Yes
Hash 39cb0d84df162d893b6ba62f261d010c389c92f2f086aa9904337cb0a6ffc08d
SimHash 6a5e1fd4ef37

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://dogs.ie/sitemap.xml

Comments

  • Scrapers please see https://dogs.ie/terms for the policy on web scraping
  • Ad content is copyright of the respective owners