djpool.net
robots.txt

Robots Exclusion Standard data for djpool.net

Resource Scan

Scan Details

Site Domain djpool.net
Base Domain djpool.net
Scan Status Ok
Last Scan2024-06-21T01:17:09+00:00
Next Scan 2024-06-28T01:17:09+00:00

Last Scan

Scanned2024-06-21T01:17:09+00:00
URL https://djpool.net/robots.txt
Domain IPs 104.21.50.166, 172.67.207.119, 2606:4700:3030::6815:32a6, 2606:4700:3037::ac43:cf77
Response IP 104.21.50.166
Found Yes
Hash 270e5b34101cb4512f057a611f121fee2f4db67b340cfeeeb661974f7b49374d
SimHash 5fc7c7c1c504

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot
semrushbot
yandex

Rule Path Comment
Disallow / prohibits crawling for the entire site

bingbot
googlebot
mediapartners-google

Rule Path
Allow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/load-scripts.php
Allow /wp-admin/load-styles.php

Comments

  • Disallow: /
  • User-agent: Bingbot
  • User-agent: Googlebot
  • Disallow: