filetypeadvisor.com
robots.txt

Robots Exclusion Standard data for filetypeadvisor.com

Resource Scan

Scan Details

Site Domain filetypeadvisor.com
Base Domain filetypeadvisor.com
Scan Status Ok
Last Scan2025-10-25T03:21:09+00:00
Next Scan 2025-11-01T03:21:09+00:00

Last Scan

Scanned2025-10-25T03:21:09+00:00
URL https://filetypeadvisor.com/robots.txt
Redirect https://www.filetypeadvisor.com/robots.txt
Redirect Domain www.filetypeadvisor.com
Redirect Base filetypeadvisor.com
Domain IPs 216.92.189.75
Redirect IPs 216.92.189.75
Response IP 216.92.189.75
Found Yes
Hash ad1a01d647f8995eecc3ecfaa4a0b8698d3661890ee32a3a1c460732127085ee
SimHash 4948ce60c7b3

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /ext/

Other Records

Field Value
sitemap https://www.filetypeadvisor.com/sitemap.xml

Warnings

  • `host` is not a known field.