Log In Sign Up

gumlet.com
robots.txt

Robots Exclusion Standard data for gumlet.com

Resource Scan

Scan Details

Site Domain gumlet.com
Base Domain gumlet.com
Scan Status Ok
Last Scan2024-06-01T04:41:51+00:00
Next Scan 2024-07-01T04:41:51+00:00

Last Scan

Scanned2024-06-01T04:41:51+00:00
URL https://gumlet.com/robots.txt
Redirect https://www.gumlet.com/robots.txt
Redirect Domain www.gumlet.com
Redirect Base gumlet.com
Domain IPs 108.156.133.114, 108.156.133.49, 108.156.133.67, 108.156.133.76, 2600:9000:2755:1e00:4:f035:4140:93a1, 2600:9000:2755:3200:4:f035:4140:93a1, 2600:9000:2755:4200:4:f035:4140:93a1, 2600:9000:2755:4e00:4:f035:4140:93a1, 2600:9000:2755:7600:4:f035:4140:93a1, 2600:9000:2755:a600:4:f035:4140:93a1, 2600:9000:2755:c000:4:f035:4140:93a1, 2600:9000:2755:d600:4:f035:4140:93a1
Redirect IPs 108.156.133.114, 108.156.133.49, 108.156.133.67, 108.156.133.76, 2600:9000:2755:1200:4:f035:4140:93a1, 2600:9000:2755:200:4:f035:4140:93a1, 2600:9000:2755:2400:4:f035:4140:93a1, 2600:9000:2755:400:4:f035:4140:93a1, 2600:9000:2755:7000:4:f035:4140:93a1, 2600:9000:2755:7e00:4:f035:4140:93a1, 2600:9000:2755:b600:4:f035:4140:93a1, 2600:9000:2755:f600:4:f035:4140:93a1
Response IP 108.156.133.76
Found Yes
Hash acfb4115d8b951bc27a694aa99e63fc33937b0032f3e303b2f44e842318c7826
SimHash 09d9dc540450

Groups

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seo spider

Rule Path
Disallow /

*

Rule Path
Disallow /*?*_rsc=*
Disallow /monitoring/
Disallow /record/
Disallow /members/
Disallow /dashboard/
Disallow /auth/
Disallow /learn/ghost/
Disallow /learn/author/
Disallow /learn/category/
Disallow /learn/tag/
Disallow /learn/members/
Disallow /blog/ghost/
Disallow /blog/author/
Disallow /blog/category/
Disallow /blog/tag/
Disallow /blog/members/
Disallow /glossary/ghost/
Disallow /glossary/author/
Disallow /glossary/tag/
Disallow /glossary/members/
Back to top

Other Records

Field Value
sitemap https://www.gumlet.com/sitemap.xml
sitemap https://www.gumlet.com/cc/sitemap.xml
sitemap https://www.gumlet.com/glossary/sitemap-posts.xml
sitemap https://www.gumlet.com/blog/sitemap-posts.xml
sitemap https://www.gumlet.com/learn/sitemap-posts.xml
Back to top