petsapartments.com
robots.txt

Robots Exclusion Standard data for petsapartments.com

Resource Scan

Scan Details

Site Domain petsapartments.com
Base Domain petsapartments.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-17T17:28:22+00:00
Next Scan 2024-11-16T17:28:22+00:00

Last Successful Scan

Scanned2024-07-20T11:29:13+00:00
URL https://www.petsapartments.com/robots.txt
Domain IPs 104.21.57.170, 172.67.147.219, 2606:4700:3030::ac43:93db, 2606:4700:3035::6815:39aa
Response IP 172.67.147.219
Found Yes
Hash 8c7d6a129dd1b43a3f3af866dcd8e2da86b153395248d0bbac630da75db70413
SimHash 081d4f13c7b2

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search*
Disallow /20*
Allow /*.html
Disallow ez3k.lovestoblog.com
Allow /

Other Records

Field Value
sitemap https://www.petsapartments.com/feeds/posts/default?orderby=UPDATED
sitemap https://www.petsapartments.com/sitemap.xml
sitemap https://www.petsapartments.com/sitemap-pages.xml
sitemap https://www.petsapartments.com/atom.xml?redirect=false&start-index=1&max-result=500
sitemap https://www.petsapartments.com/atom.xml?redirect=false&start-index=501&max-result=500
sitemap https://www.petsapartments.com/atom.xml?redirect=false&start-index=1001&max-result=500

Comments

  • below lines control all search engines, and blocks all search, archieve and allow all blog posts and pages.
  • sitemap of the blog
  • sitemap of the blog - search-console - developers.google.com - ez3k