recentinfos.in
robots.txt

Robots Exclusion Standard data for recentinfos.in

Resource Scan

Scan Details

Site Domain recentinfos.in
Base Domain recentinfos.in
Scan Status Ok
Last Scan2026-01-30T22:04:57+00:00
Next Scan 2026-02-06T22:04:57+00:00

Last Scan

Scanned2026-01-30T22:04:57+00:00
URL https://recentinfos.in/robots.txt
Redirect https://www.recentinfos.in/robots.txt
Redirect Domain www.recentinfos.in
Redirect Base recentinfos.in
Domain IPs 208.97.186.232
Redirect IPs 208.97.186.232
Response IP 208.97.186.232
Found Yes
Hash ca461f5c4ac1dd06f66de6438db856af11d737f5136db5ac0e91633cd7bb25bc
SimHash 01339173eca6

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /login/ -
Disallow /cgi-bin/ -
Disallow /*?s=* Disallow search result pages
Disallow /*.pdf Disallow PDF files
Disallow /*.docx Disallow Word documents
Allow /wp-admin/admin-ajax.php -

googlebot

Rule Path Comment
Disallow /private/ Example of a private directory

googlebot-news

Rule Path
Allow /

bingbot

Rule Path Comment
Disallow /not-for-bing/ Example of a directory not for Bing

Other Records

Field Value
sitemap https://www.recentinfos.in/sitemap.xml
sitemap https://www.recentinfos.in/sitemap-news.xml
sitemap https://www.recentinfos.in/sitemap_index.xml

Comments

  • Allow all search engines to crawl the site
  • Allow specific files in wp-admin
  • Specific user agents with disallowed paths
  • Sitemap location