freeshib.biz
robots.txt

Robots Exclusion Standard data for freeshib.biz

Resource Scan

Scan Details

Site Domain freeshib.biz
Base Domain freeshib.biz
Scan Status Ok
Last Scan2025-04-10T13:34:20+00:00
Next Scan 2025-04-17T13:34:20+00:00

Last Scan

Scanned2025-04-10T13:34:20+00:00
URL https://freeshib.biz/robots.txt
Domain IPs 104.21.90.165, 172.67.158.50, 2606:4700:3032::ac43:9e32, 2606:4700:3037::6815:5aa5
Response IP 172.67.158.50
Found Yes
Hash 0e3c3b2aa8809f7975420a6e4dff073e0edb97f2b83f159e1103e443a7f939e3
SimHash 691cc872c693

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Allow /

Other Records

Field Value
sitemap https://freeshib.biz/sitemap.xml