nflpickwatch.com
robots.txt

Robots Exclusion Standard data for nflpickwatch.com

Resource Scan

Scan Details

Site Domain nflpickwatch.com
Base Domain nflpickwatch.com
Scan Status Ok
Last Scan2026-02-06T04:28:35+00:00
Next Scan 2026-02-13T04:28:35+00:00

Last Scan

Scanned2026-02-06T04:28:35+00:00
URL https://nflpickwatch.com/robots.txt
Domain IPs 172.66.40.152, 172.66.43.104, 2606:4700:3108::ac42:2898, 2606:4700:3108::ac42:2b68
Response IP 172.66.40.152
Found Yes
Hash b604411149bbd2cdd4c072068523ecea97d907cb556b50800a3b115a6de33c4a
SimHash 626cde28a61a

Groups

semrushbot
blexbot
ahrefsbot
facebookbot
facebookexternalhit
petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

megaindex.ru/2.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-*
Disallow /xmlrpc.php
Disallow /?s=
Disallow /trackback/
Disallow /wp-json/

Other Records

Field Value
sitemap https://assets.nflpickwatch.com/sitemaps/index.xml

Comments

  • Delay robots
  • Block robots
  • Block paths