Log In Sign Up

shaurmag.com
robots.txt

Robots Exclusion Standard data for shaurmag.com

Resource Scan

Scan Details

Site Domain shaurmag.com
Base Domain shaurmag.com
Scan Status Ok
Last Scan2025-05-01T17:08:24+00:00
Next Scan 2025-05-08T17:08:24+00:00

Last Scan

Scanned2025-05-01T17:08:24+00:00
URL https://shaurmag.com/robots.txt
Domain IPs 104.21.86.113, 172.67.218.148, 2606:4700:3032::6815:5671, 2606:4700:3032::ac43:da94
Response IP 172.67.218.148
Found Yes
Hash 97a2e09528e7cf1ef10e9ad8ae552045056a2a2400db2d5985cc84e2b6617280
SimHash a882b8c74bf5

Groups

*

Rule Path
Disallow /test
Disallow /dev
Back to top

Other Records

Field Value
sitemap https://shaurmag.com/sitemap.xml
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-01
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-02
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-03
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-04
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-05
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-06
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-07
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-08
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-09
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-10
sitemap https://shaurmag.com/index.php?xml_sitemap=params=pt-post-2018-11
sitemap https://shaurmag.com/sitemap-misc.xml
sitemap https://shaurmag.com/sitemap-tax-post_tag.xml
sitemap https://shaurmag.com/sitemap-tax-category.xml
Back to top