stories.diariodecadiz.es
robots.txt

Robots Exclusion Standard data for stories.diariodecadiz.es

Resource Scan

Scan Details

Site Domain stories.diariodecadiz.es
Base Domain diariodecadiz.es
Scan Status Ok
Last Scan2024-11-11T05:11:36+00:00
Next Scan 2024-11-18T05:11:36+00:00

Last Scan

Scanned2024-11-11T05:11:36+00:00
URL https://stories.diariodecadiz.es/robots.txt
Domain IPs 51.75.166.68, 51.75.166.69, 51.75.166.70, 51.75.166.71, 51.75.166.72, 51.75.166.73
Response IP 51.75.166.71
Found Yes
Hash 09a91b9c8e43e2d9e330ebaa368978393cf263c1a1a3e5ff2390df83e67b6775
SimHash 3b429998c7f0

Groups

twitterbot
linkedinbot
mediapartners-google
adsbot-google
adsbot-google-mobile
facebookexternalhit
facebookcatalog

Rule Path
Allow /
Allow /media/

*

Rule Path
Allow /
Allow /ads.txt
Allow /*/amp/
Allow /amp/
Allow /home/
Allow /.well-known/amphtml/apikey.pub
Allow /.well-known/apple-developer-merchantid-domain-association
Disallow /api/amp_story_auto_ads.php