stories.sport.es
robots.txt

Robots Exclusion Standard data for stories.sport.es

Resource Scan

Scan Details

Site Domain stories.sport.es
Base Domain sport.es
Scan Status Ok
Last Scan2024-11-16T22:59:13+00:00
Next Scan 2024-11-23T22:59:13+00:00

Last Scan

Scanned2024-11-16T22:59:13+00:00
URL https://stories.sport.es/robots.txt
Domain IPs 51.75.166.68, 51.75.166.69, 51.75.166.70, 51.75.166.71, 51.75.166.72, 51.75.166.73
Response IP 51.75.166.70
Found Yes
Hash 09a91b9c8e43e2d9e330ebaa368978393cf263c1a1a3e5ff2390df83e67b6775
SimHash 3b429998c7f0

Groups

twitterbot
linkedinbot
mediapartners-google
adsbot-google
adsbot-google-mobile
facebookexternalhit
facebookcatalog

Rule Path
Allow /
Allow /media/

*

Rule Path
Allow /
Allow /ads.txt
Allow /*/amp/
Allow /amp/
Allow /home/
Allow /.well-known/amphtml/apikey.pub
Allow /.well-known/apple-developer-merchantid-domain-association
Disallow /api/amp_story_auto_ads.php