stories.as.com
robots.txt

Robots Exclusion Standard data for stories.as.com

Resource Scan

Scan Details

Site Domain stories.as.com
Base Domain as.com
Scan Status Ok
Last Scan2024-05-29T04:09:07+00:00
Next Scan 2024-06-05T04:09:07+00:00

Last Scan

Scanned2024-05-29T04:09:07+00:00
URL https://stories.as.com/robots.txt
Domain IPs 51.75.166.68, 51.75.166.69, 51.75.166.70, 51.75.166.71, 51.75.166.72, 51.75.166.73
Response IP 51.75.166.72
Found Yes
Hash c0b307893647f536fa261cb7d84deba36a70d8b6b9ac1051a26e2aab56a3adbf
SimHash 2b42d830c5f1

Groups

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookcatalog

Rule Path
Allow /

facebookcatalog/1.0

Rule Path
Allow /

*

Rule Path
Disallow /media/
Allow /
Allow /ads.txt
Allow /*/amp/
Allow /amp/
Allow /.well-known/amphtml/apikey.pub
Disallow /api/amp_story_auto_ads.php