petsvill.com
robots.txt

Robots Exclusion Standard data for petsvill.com

Resource Scan

Scan Details

Site Domain petsvill.com
Base Domain petsvill.com
Scan Status Ok
Last Scan2024-11-13T14:04:38+00:00
Next Scan 2024-11-20T14:04:38+00:00

Last Scan

Scanned2024-11-13T14:04:38+00:00
URL https://www.petsvill.com/robots.txt
Domain IPs 47.88.88.200
Response IP 47.88.88.200
Found Yes
Hash 1ed3dc565e8a29499c14851727934c56d88f5ba1f136ea80b91ca1ac51b73ee6
SimHash d957d80a8093

Groups

*

Rule Path
Disallow /bin/
Disallow /bin/*
Disallow /User/
Disallow /User/*
Disallow /Search/
Disallow /Search/*
Disallow /search/
Disallow /search/*
Disallow /page/
Disallow /page/*
Disallow /?s=
Disallow /?s=*
Disallow *.json
Disallow *.asp
Disallow *.aspx
Disallow *.php
Disallow *.py
Disallow *.cgi

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.petsvill.com/sitemap.xml
sitemap https://www.petsvill.com/sitemap_1.xml