vwfs.it
robots.txt

Robots Exclusion Standard data for vwfs.it

Resource Scan

Scan Details

Site Domain vwfs.it
Base Domain vwfs.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-24T20:29:17+00:00
Next Scan 2026-03-24T20:29:17+00:00

Last Successful Scan

Scanned2025-05-05T21:46:58+00:00
URL https://www.vwfs.it/robots.txt
Redirect https://www.vwfs.it/configs/robots.generate.html
Domain IPs 13.226.175.105, 13.226.175.125, 13.226.175.40, 13.226.175.76
Response IP 18.165.121.64
Found Yes
Hash de1a065ed1074ad97825b80b17362bca497d5c61341a57fa3ae93f56216a3b6f
SimHash 6f499cc447b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

Other Records

Field Value
sitemap https://www.vwfs.it/sitemap.xml

Warnings

  • `host` is not a known field.