metrosiliconvalley.com
robots.txt

Robots Exclusion Standard data for metrosiliconvalley.com

Resource Scan

Scan Details

Site Domain metrosiliconvalley.com
Base Domain metrosiliconvalley.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-19T12:08:52+00:00
Next Scan 2024-06-17T12:08:52+00:00

Last Successful Scan

Scanned2023-11-21T11:44:52+00:00
URL https://www.metrosiliconvalley.com/robots.txt
Domain IPs 104.21.64.138, 172.67.151.53, 2606:4700:3030::ac43:9735, 2606:4700:3032::6815:408a
Response IP 172.67.151.53
Found Yes
Hash c917ce4511fc221a94ec2e5adadb41e8c3a61f6ef1d88d79bf78f0707f32748b
SimHash 6d00dc40cf57

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap /event-sitemap.xml

Comments

  • WP Import Export Rule