5thgenrams.com
robots.txt

Robots Exclusion Standard data for 5thgenrams.com

Resource Scan

Scan Details

Site Domain 5thgenrams.com
Base Domain 5thgenrams.com
Scan Status Ok
Last Scan2024-11-17T18:34:23+00:00
Next Scan 2024-11-24T18:34:23+00:00

Last Scan

Scanned2024-11-17T18:34:23+00:00
URL https://5thgenrams.com/robots.txt
Domain IPs 104.21.51.7, 172.67.216.39, 2606:4700:3032::6815:3307, 2606:4700:3034::ac43:d827
Response IP 104.21.51.7
Found Yes
Hash 732f694564e593ffe380ced5bd2fb2c58813b8d8801e6991a723c7dfb781c582
SimHash 28549b875611

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

teoma

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.5thgenrams.com/sitemap.xml
sitemap https://www.5thgenrams.com/sitemap_index.xml
sitemap https://www.5thgenrams.com/attachment-sitemap.xml
sitemap https://www.5thgenrams.com/category-sitemap.xml
sitemap https://www.5thgenrams.com/page-sitemap.xml
sitemap https://www.5thgenrams.com/post-sitemap.xml
sitemap https://www.5thgenrams.com/community/sitemap.php