youngloved.com
robots.txt

Robots Exclusion Standard data for youngloved.com

Resource Scan

Scan Details

Site Domain youngloved.com
Base Domain youngloved.com
Scan Status Ok
Last Scan2025-07-25T12:59:37+00:00
Next Scan 2025-08-24T12:59:37+00:00

Last Scan

Scanned2025-07-25T12:59:37+00:00
URL https://youngloved.com/robots.txt
Domain IPs 15.197.246.237, 3.33.193.101, 52.223.46.195, 99.83.183.127
Response IP 52.223.46.195
Found Yes
Hash 0b703df03fd9d49fcbfaeaf5b7586dad416825fd073b4bf2f0e2c0ae0f2b6c68
SimHash ab3acb21e3dd

Groups

*

Rule Path
Disallow /profile-settings
Disallow /l/new
Disallow /l/*/checkout
Disallow /l/*/draft
Disallow /l/*/pending-approval
Disallow /l/*/new
Disallow /l/*/edit
Disallow /inbox
Disallow /order
Disallow /sale
Disallow /listings
Disallow /account
Disallow /reset-password
Disallow /verify-email
Disallow /preview

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://young-loved-fefec9d901db.herokuapp.com/sitemap-index.xml

Comments

  • Hello bot! There are some routes that need authentication. You should avoid them :)