thelallantop.com
robots.txt

Robots Exclusion Standard data for thelallantop.com

Resource Scan

Scan Details

Site Domain thelallantop.com
Base Domain thelallantop.com
Scan Status Ok
Last Scan2024-05-17T19:53:25+00:00
Next Scan 2024-05-24T19:53:25+00:00

Last Scan

Scanned2024-05-17T19:53:25+00:00
URL https://thelallantop.com/robots.txt
Redirect https://www.thelallantop.com:443/robots.txt
Redirect Domain www.thelallantop.com
Redirect Base thelallantop.com
Domain IPs 13.126.39.152, 3.109.10.114, 52.66.100.161
Redirect IPs 13.33.30.103, 13.33.30.116, 13.33.30.127, 13.33.30.52, 2600:9000:229f:1400:f:8708:b340:93a1, 2600:9000:229f:3e00:f:8708:b340:93a1, 2600:9000:229f:6600:f:8708:b340:93a1, 2600:9000:229f:8800:f:8708:b340:93a1, 2600:9000:229f:9800:f:8708:b340:93a1, 2600:9000:229f:d000:f:8708:b340:93a1, 2600:9000:229f:e800:f:8708:b340:93a1, 2600:9000:229f:ec00:f:8708:b340:93a1
Response IP 13.33.30.116
Found Yes
Hash 0bf2968da05d7df258c78445fb00c90678e506f00aa576c2b8bb28c5ca199272
SimHash cb089f200753

Groups

*

Rule Path
Allow /
Disallow /*?*
Disallow /%5B%5Ea-zA-Z0-9_%5D
Disallow /vs/header_lt
Disallow /vs/footer_lt
Disallow /visualstories/preview/*
Disallow /visual-stories/
Disallow /preferences
Disallow /public/
Disallow /login
Disallow /login*
Disallow /quiz/faq-app
Disallow /testVsWidget
Disallow /all/election/faqs

grapeshot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thelallantop.com/sitemap.xml
sitemap https://www.thelallantop.com/visualstories/sitemap.xml
sitemap https://www.thelallantop.com/visualstories/webstories-sitemap-v1.xml
sitemap https://www.thelallantop.com/visualstories/webstories-sitemap-v1-1.xml