rgtechnicalboy.com
robots.txt

Robots Exclusion Standard data for rgtechnicalboy.com

Resource Scan

Scan Details

Site Domain rgtechnicalboy.com
Base Domain rgtechnicalboy.com
Scan Status Ok
Last Scan3/8/2025, 5:30:52 AM
Next Scan 3/15/2025, 5:30:52 AM

Last Scan

Scanned3/8/2025, 5:30:52 AM
URL https://rgtechnicalboy.com/robots.txt
Redirect https://www.rgtechnicalboy.com/robots.txt
Redirect Domain www.rgtechnicalboy.com
Redirect Base rgtechnicalboy.com
Domain IPs 2a02:4780:84:29f3:cde5:3167:c64e:2981, 84.32.84.136
Redirect IPs 2a02:4780:39:346a:1f79:37d8:d7f1:5779, 93.127.201.171
Response IP 77.37.48.34
Found Yes
Hash 6b4d596a975244a5257bda4fc5694173cf445c37fc684cd8e7d7acc4cd93bb41
SimHash 6100c175c4d1

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/
Allow /ads.txt

Other Records

Field Value
sitemap https://www.rgtechnicalboy.com/sitemap.xml
sitemap https://www.rgtechnicalboy.com/news-sitemap.xml
sitemap https://www.rgtechnicalboy.com/sitemap.xml

Warnings

  • `user agent` is not a known field.