theblackgem.net
robots.txt

Robots Exclusion Standard data for theblackgem.net

Resource Scan

Scan Details

Site Domain theblackgem.net
Base Domain theblackgem.net
Scan Status Ok
Last Scan2025-08-19T06:24:10+00:00
Next Scan 2025-08-26T06:24:10+00:00

Last Scan

Scanned2025-08-19T06:24:10+00:00
URL https://theblackgem.net/robots.txt
Redirect https://www.theblackgem.net/robots.txt
Redirect Domain www.theblackgem.net
Redirect Base theblackgem.net
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.12.121, 2404:6800:4003:c06::79
Response IP 142.251.12.121
Found Yes
Hash 4e10973ba8b94f46dcb2875cf1a7f4c8b25ac16e8a5928c26a3f2d30b477dda0
SimHash 0954d2504f13

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Disallow /share-widget
Allow /

Other Records

Field Value
sitemap https://www.theblackgem.net/sitemap.xml