stories.diariodenavarra.es
robots.txt

Robots Exclusion Standard data for stories.diariodenavarra.es

Resource Scan

Scan Details

Site Domain stories.diariodenavarra.es
Base Domain diariodenavarra.es
Scan Status Ok
Last Scan2024-10-09T21:56:10+00:00
Next Scan 2024-10-16T21:56:10+00:00

Last Scan

Scanned2024-10-09T21:56:10+00:00
URL https://stories.diariodenavarra.es/robots.txt
Domain IPs 51.75.166.68, 51.75.166.69, 51.75.166.70, 51.75.166.71, 51.75.166.72, 51.75.166.73
Response IP 51.75.166.73
Found Yes
Hash 4acaf89fa275a3b5cb5fdffc3851a675fd26b601c762464e30ed99fc974b02a9
SimHash 2b42d830c5f1

Groups

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookcatalog

Rule Path
Allow /

facebookcatalog/1.0

Rule Path
Allow /

*

Rule Path
Disallow /
Allow /ads.txt
Allow /*/amp/
Allow /amp/
Allow /media/
Allow /.well-known/amphtml/apikey.pub
Disallow /api/amp_story_auto_ads.php