keithbarney.me
robots.txt

Robots Exclusion Standard data for keithbarney.me

Resource Scan

Scan Details

Site Domain keithbarney.me
Base Domain keithbarney.me
Scan Status Ok
Last Scan2025-10-25T18:45:25+00:00
Next Scan 2025-11-01T18:45:25+00:00

Last Scan

Scanned2025-10-25T18:45:25+00:00
URL https://keithbarney.me/robots.txt
Redirect https://za.free-catalog.online/robots.txt
Redirect Domain za.free-catalog.online
Redirect Base free-catalog.online
Domain IPs 213.189.54.98
Redirect IPs 213.189.54.98
Response IP 213.189.54.98
Found Yes
Hash 288b30dd6dbdb736277a00aed7c42388bcee1bc03c410ac06f01d119c1af83fb
SimHash 8944d644c711

Groups

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /*index
Disallow /*.txt

Other Records

Field Value
sitemap https://za.free-catalog.online/sitemap.xml

Warnings

  • `host` is not a known field.