tumblenet.ga
robots.txt

Robots Exclusion Standard data for tumblenet.ga

Resource Scan

Scan Details

Site Domain tumblenet.ga
Base Domain tumblenet.ga
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-06-26T22:13:38+00:00
Next Scan 2024-09-24T22:13:38+00:00

Last Successful Scan

Scanned2023-05-07T22:20:08+00:00
URL https://tumblenet.ga/robots.txt
Redirect https://www.tumblenet.ga/robots.txt
Redirect Domain www.tumblenet.ga
Redirect Base tumblenet.ga
Domain IPs 104.21.6.201, 172.67.135.62, 2606:4700:3031::ac43:873e, 2606:4700:3035::6815:6c9
Redirect IPs 104.21.6.201, 172.67.135.62, 2606:4700:3031::ac43:873e, 2606:4700:3035::6815:6c9
Response IP 172.67.135.62
Found Yes
Hash 9afacfe4b29e592d03216fe1a39c29d5a097340d2fe953c6dfc1cb83a356f3a6
SimHash b952b949dc16

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap http://www.tumblenet.ga/sitemap.xml

Comments

  • filter pages and documents for the noindex key
  • robotstxt.org - if _config production variable is false robots will be disallowed.