portfolio.forkwell.com
robots.txt

Robots Exclusion Standard data for portfolio.forkwell.com

Resource Scan

Scan Details

Site Domain portfolio.forkwell.com
Base Domain forkwell.com
Scan Status Ok
Last Scan2024-10-20T03:10:10+00:00
Next Scan 2024-11-19T03:10:10+00:00

Last Scan

Scanned2024-10-20T03:10:10+00:00
URL https://portfolio.forkwell.com/robots.txt
Domain IPs 13.35.238.126, 13.35.238.128, 13.35.238.15, 13.35.238.60
Response IP 13.35.238.126
Found Yes
Hash dab169e2c4273bd9d98b9fec8421d6a6f3e239a6ad51d872aa9b89aecd55e5dc
SimHash 0a0dc8408993

Groups

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://s3-ap-northeast-1.amazonaws.com/forkwell/sitemaps/production/portfolio/sitemap.xml.gz

Comments

  • https://grooves.slack.com/archives/CL3FJ6CAZ/p1568428025009000