panamagol.com
robots.txt

Robots Exclusion Standard data for panamagol.com

Resource Scan

Scan Details

Site Domain panamagol.com
Base Domain panamagol.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T06:24:15+00:00
Next Scan 2024-10-17T06:24:15+00:00

Last Successful Scan

Scanned2024-08-27T17:43:35+00:00
URL https://panamagol.com/robots.txt
Domain IPs 104.21.8.118, 172.67.130.113, 2606:4700:3031::ac43:8271, 2606:4700:3035::6815:876
Response IP 104.21.8.118
Found Yes
Hash 5141d275d7a3b2234f9f6cc773e41f40e845a04d8cc7b3cf5da1a86da7454698
SimHash e2084cd106fb

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /feed/$
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /trackback/
Disallow /wp-admin/
Disallow /feed/
Disallow /?s=
Disallow /search
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /xmlrpc.php
Disallow /?attachment_id*
Disallow /comments/
Disallow /*/attachment/
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /page/

googlebot
googlebot-image

Rule Path
Allow /wp-content/uploads/
Allow /*.css$
Allow /*.js$
Disallow /wp-includes/

mediapartners-google*

Rule Path
Disallow

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msiecrawler
webcopier
httrack
microsoft.url.control
libwww
xenu
larbin
zyborg
download ninja
wget

Rule Path
Disallow /

Other Records

Field Value
sitemap https://panamagol.com/sitemap.xml

Comments

  • Robots.txt de panamagol.com
  • Bots específicos
  • Bots y crawlers indeseados