wallstreetpit.com
robots.txt

Robots Exclusion Standard data for wallstreetpit.com

Resource Scan

Scan Details

Site Domain wallstreetpit.com
Base Domain wallstreetpit.com
Scan Status Ok
Last Scan2024-11-09T13:14:25+00:00
Next Scan 2024-11-16T13:14:25+00:00

Last Scan

Scanned2024-11-09T13:14:25+00:00
URL https://wallstreetpit.com/robots.txt
Domain IPs 172.232.161.203
Response IP 172.232.161.203
Found Yes
Hash 5f3497cc3b05fb3aa6d5984487b5275406dc5723f04431a56ef504187b6a83f6
SimHash e9017d4147f3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow *.pdf
Disallow /cgi-bin/
Disallow /*.php$
Disallow /*.inc$
Disallow /terms-of-use/
Disallow /privacy-policy/

Other Records

Field Value
sitemap https://wallstreetpit.com/sitemaps.xml