indienet.info
robots.txt

Robots Exclusion Standard data for indienet.info

Resource Scan

Scan Details

Site Domain indienet.info
Base Domain indienet.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-12T01:46:29+00:00
Next Scan 2024-10-12T01:46:29+00:00

Last Successful Scan

Scanned2024-07-21T13:10:07+00:00
URL https://indienet.info/robots.txt
Domain IPs 104.21.13.228, 172.67.133.102, 2606:4700:3031::ac43:8566, 2606:4700:3034::6815:de4
Response IP 172.67.133.102
Found Yes
Hash 785639f91f38fcc7973d1a314d3eb16337be57a0c852d15433af4bf67cdd6f7e
SimHash a918ce502081

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://indienet.info/sitemaps.xml
sitemap https://indienet.info/sitemap-basement-1.xml
sitemap https://indienet.info/sitemap-basement-2.xml
sitemap https://indienet.info/sitemap-basement-3.xml
sitemap https://indienet.info/sitemap-basement-4.xml
sitemap https://indienet.info/sitemap-basement-5.xml
sitemap https://indienet.info/sitemap-basement-6.xml
sitemap https://indienet.info/sitemap-basement-7.xml
sitemap https://indienet.info/sitemap-basement-8.xml
sitemap https://indienet.info/sitemap-basement-9.xml
sitemap https://indienet.info/sitemap-basement-10.xml
sitemap https://indienet.info/sitemap-basement-11.xml
sitemap https://indienet.info/sitemap-basement-12.xml
sitemap https://indienet.info/sitemap-basement-13.xml
sitemap https://indienet.info/sitemap-basement-14.xml
sitemap https://21mw.indienet.info/sitemap-base.xml
sitemap https://07mw.indienet.info/sitemaps-base.xml
sitemap https://04mw.indienet.info/sitemaps-base.xml