thestreamingblog.com
robots.txt

Robots Exclusion Standard data for thestreamingblog.com

Resource Scan

Scan Details

Site Domain thestreamingblog.com
Base Domain thestreamingblog.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-16T05:33:32+00:00
Next Scan 2025-12-15T05:33:32+00:00

Last Successful Scan

Scanned2025-02-19T03:45:47+00:00
URL https://thestreamingblog.com/robots.txt
Redirect https://cryptau.io/robots.txt
Redirect Domain cryptau.io
Redirect Base cryptau.io
Domain IPs 104.21.35.208, 172.67.179.147, 2606:4700:3030::ac43:b393, 2606:4700:3031::6815:23d0
Redirect IPs 104.21.46.210, 172.67.142.49, 2606:4700:3030::6815:2ed2, 2606:4700:3037::ac43:8e31
Response IP 172.67.142.49
Found Yes
Hash eaf4b007be39400989653a8363f877bb6e32e2e7cb63c42d2793cdff9dd2f59d
SimHash 61005c00c993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://cryptau.io/sitemap_index.xml