digitalpeer.com
robots.txt

Robots Exclusion Standard data for digitalpeer.com

Resource Scan

Scan Details

Site Domain digitalpeer.com
Base Domain digitalpeer.com
Scan Status Ok
Last Scan2025-10-09T01:09:44+00:00
Next Scan 2025-10-16T01:09:44+00:00

Last Scan

Scanned2025-10-09T01:09:44+00:00
URL https://digitalpeer.com/robots.txt
Redirect http://www.digitalpeer.com/robots.txt
Redirect Domain www.digitalpeer.com
Redirect Base digitalpeer.com
Domain IPs 192.145.233.51
Redirect IPs 192.145.233.51
Response IP 192.145.233.51
Found Yes
Hash d81342f5d17a140eb07aae04db9d741be35c31db5a178e115331bb19c2596fa8
SimHash 6a35afc9efdf

Groups

*

Rule Path
Disallow /pub

Other Records

Field Value
crawl-delay 30

googlebot-image

Rule Path
Disallow /blog/file/

Other Records

Field Value
sitemap http://www.digitalpeer.com/blog/sitemap.xml

Comments

  • Any use of robots.txt failing to obey the robots exclusion standards set
  • forth at <http://www.robotstxt.org/ wc/ exclusion.html> is strictly
  • prohibited.
  • blog sitemap