expandedramblings.com
robots.txt

Robots Exclusion Standard data for expandedramblings.com

Resource Scan

Scan Details

Site Domain expandedramblings.com
Base Domain expandedramblings.com
Scan Status Ok
Last Scan2024-06-27T00:03:14+00:00
Next Scan 2024-07-04T00:03:14+00:00

Last Scan

Scanned2024-06-27T00:03:14+00:00
URL https://expandedramblings.com/robots.txt
Domain IPs 104.26.4.198, 104.26.5.198, 172.67.75.88, 2606:4700:20::681a:4c6, 2606:4700:20::681a:5c6, 2606:4700:20::ac43:4b58
Response IP 172.67.75.88
Found Yes
Hash 3b0625f8dbe18478cb5a1e59061760c4e7565bc7451d3367c421a3005d4a83a2
SimHash 0c15d8348181

Groups

*
googlebot

Rule Path
Allow /*.js$
Allow /*.css$

gptbotdisallow: /
gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://expandedramblings.com/category-sitemap.xml
sitemap https://expandedramblings.com/download-sitemap.xml
sitemap https://expandedramblings.com/post-sitemap4.xml
sitemap https://expandedramblings.com/post-sitemap3.xml
sitemap https://expandedramblings.com/post-sitemap2.xml
sitemap https://expandedramblings.com/post-sitemap1.xml
sitemap https://expandedramblings.com/page-sitemap.xml
sitemap https://expandedramblings.com/post_tag-sitemap.xml

Comments

  • Allow all files ending with these extensions