stories.noticiasdenavarra.com
robots.txt

Robots Exclusion Standard data for stories.noticiasdenavarra.com

Resource Scan

Scan Details

Site Domain stories.noticiasdenavarra.com
Base Domain noticiasdenavarra.com
Scan Status Ok
Last Scan2024-05-26T10:26:25+00:00
Next Scan 2024-06-02T10:26:25+00:00

Last Scan

Scanned2024-05-26T10:26:25+00:00
URL https://stories.noticiasdenavarra.com/robots.txt
Response IP 51.75.166.70
Found Yes
Hash 09a91b9c8e43e2d9e330ebaa368978393cf263c1a1a3e5ff2390df83e67b6775
SimHash 3b429998c7f0

Groups

twitterbot
linkedinbot
mediapartners-google
adsbot-google
adsbot-google-mobile
facebookexternalhit
facebookcatalog

Rule Path
Allow /
Allow /media/

*

Rule Path
Allow /
Allow /ads.txt
Allow /*/amp/
Allow /amp/
Allow /home/
Allow /.well-known/amphtml/apikey.pub
Allow /.well-known/apple-developer-merchantid-domain-association
Disallow /api/amp_story_auto_ads.php