duplicatefilescanner.com
robots.txt

Robots Exclusion Standard data for duplicatefilescanner.com

Resource Scan

Scan Details

Site Domain duplicatefilescanner.com
Base Domain duplicatefilescanner.com
Scan Status Ok
Last Scan2025-06-01T14:24:41+00:00
Next Scan 2025-07-01T14:24:41+00:00

Last Scan

Scanned2025-06-01T14:24:41+00:00
URL https://duplicatefilescanner.com/robots.txt
Redirect https://www.duplicatefilescanner.com/robots.txt
Redirect Domain www.duplicatefilescanner.com
Redirect Base duplicatefilescanner.com
Domain IPs 162.214.80.130
Redirect IPs 162.214.80.130
Response IP 162.214.80.130
Found Yes
Hash d2a7d0b1db261996f59e31af4d42361010f4d953958a7c0a1e3d9d2e0cff4bf2
SimHash f10d55444dd3

Groups

*

Rule Path
Disallow /useless_file.html

Other Records

Field Value
sitemap https://www.tgsanetechnologies.com/sitemap.xml