techwebltd.com
robots.txt

Robots Exclusion Standard data for techwebltd.com

Resource Scan

Scan Details

Site Domain techwebltd.com
Base Domain techwebltd.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-06-06T03:49:42+00:00
Next Scan 2025-06-20T03:49:42+00:00

Last Successful Scan

Scanned2025-05-22T03:43:22+00:00
URL https://techwebltd.com/robots.txt
Domain IPs 125.253.92.186
Response IP 125.253.92.186
Found Yes
Hash 9e90fe6417b5db85846c301c9cf2259d59e23b4fc37ee0f45b93f4bd3b890666
SimHash 71055467c792

Groups

*

Rule Path
Disallow /private/
Allow /private/special-page.html

Other Records

Field Value
sitemap https://techwebltd.com/sitemap.xml