thesportsnews.in
robots.txt

Robots Exclusion Standard data for thesportsnews.in

Resource Scan

Scan Details

Site Domain thesportsnews.in
Base Domain thesportsnews.in
Scan Status Ok
Last Scan2024-11-16T10:23:01+00:00
Next Scan 2024-11-23T10:23:01+00:00

Last Scan

Scanned2024-11-16T10:23:01+00:00
URL https://thesportsnews.in/robots.txt
Domain IPs 2a02:4780:38:3914:af56:56:21e8:1a75, 93.127.201.54
Response IP 93.127.187.163
Found Yes
Hash 60bc16aef571836caef4a12db758dfcb920cb3f920f27ba31e4c5fefac0d9903
SimHash 7105d9418034

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

awariorssbot
awariosmartbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ezoicbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.thesportsnews.in/sitemap-news.xml
sitemap https://www.thesportsnews.in/sitemap_index.xml
sitemap https://www.thesportsnews.in/post-sitemap.xml
sitemap https://www.thesportsnews.in/post-sitemap2.xml
sitemap https://www.thesportsnews.in/post-sitemap3.xml
sitemap https://www.thesportsnews.in/post-sitemap4.xml
sitemap https://www.thesportsnews.in/page-sitemap.xml
sitemap https://www.thesportsnews.in/category-sitemap.xml
sitemap https://www.thesportsnews.in/author-sitemap.xml
sitemap https://www.thesportsnews.in/post_tag-sitemap.xml
sitemap https://www.thesportsnews.in/post_tag-sitemap2.xml
sitemap https://www.thesportsnews.in/post_tag-sitemap3.xml
sitemap https://www.thesportsnews.in/post_tag-sitemap4.xml