Log In Sign Up

infosearched.com
robots.txt

Robots Exclusion Standard data for infosearched.com

Resource Scan

Scan Details

Site Domain infosearched.com
Base Domain infosearched.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/13/2025, 8:33:10 PM
Next Scan 6/11/2025, 8:33:10 PM

Last Successful Scan

Scanned8/21/2023, 9:08:04 PM
URL https://infosearched.com/robots.txt
Redirect https://www.infosearched.com/robots.txt
Redirect Domain www.infosearched.com
Redirect Base infosearched.com
Domain IPs 104.21.21.223, 172.67.200.217, 2606:4700:3030::6815:15df, 2606:4700:3035::ac43:c8d9
Redirect IPs 104.21.21.223, 172.67.200.217, 2606:4700:3030::6815:15df, 2606:4700:3035::ac43:c8d9
Response IP 104.21.21.223
Found Yes
Hash ec96d8f63e8a59c9f45c4a5cb6e8c239c40e32b56e433bcac13e443d42381756
SimHash 78084c0702b2

Groups

scrapy/2.5.1 (+https://scrapy.org)

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://www.infosearched.com/sitemap_index.xml
sitemap https://www.infosearched.com/news-sitemap.xml
sitemap https://www.infosearched.com/video-sitemap.xml
sitemap https://business.infosearched.com/video-sitemap.xml
sitemap https://business.infosearched.com/sitemap_index.xml
sitemap https://business.infosearched.com/news-sitemap.xml
sitemap https://entertainment.infosearched.com/sitemap_index.xml
sitemap https://entertainment.infosearched.com/video-sitemap.xml
sitemap https://entertainment.infosearched.com/news-sitemap.xml
sitemap https://health.infosearched.com/sitemap_index.xml
sitemap https://health.infosearched.com/video-sitemap.xml
sitemap https://health.infosearched.com/news-sitemap.xml
sitemap https://sports.infosearched.com/sitemap_index.xml
sitemap https://sports.infosearched.com/video-sitemap.xml
sitemap https://travel.infosearched.com/sitemap_index.xml
sitemap https://travel.infosearched.com/video-sitemap.xml
sitemap https://travel.infosearched.com/news-sitemap.xml
sitemap https://lifestyle.infosearched.com/sitemap_index.xml
sitemap https://lifestyle.infosearched.com/video-sitemap.xml
sitemap https://lifestyle.infosearched.com/news-sitemap.xml
sitemap https://gaming.infosearched.com/sitemap_index.xml
sitemap https://gaming.infosearched.com/video-sitemap.xml
sitemap https://gaming.infosearched.com/news-sitemap.xml
sitemap https://tech.infosearched.com/sitemap_index.xml
sitemap https://tech.infosearched.com/video-sitemap.xml
sitemap https://tech.infosearched.com/news-sitemap.xml
sitemap https://reviews.infosearched.com/sitemap_index.xml
sitemap https://reviews.infosearched.com/video-sitemap.xml
sitemap https://reviews.infosearched.com/news-sitemap.xml
sitemap https://news.infosearched.com/sitemap_index.xml
sitemap https://news.infosearched.com/news-sitemap.xml
sitemap https://news.infosearched.com/video-sitemap.xml
Back to top

Comments

  • Termly scanner
Back to top

Warnings

  • `stiemap` is not a known field.
Back to top