kinkmen.com
robots.txt

Robots Exclusion Standard data for kinkmen.com

Resource Scan

Scan Details

Site Domain kinkmen.com
Base Domain kinkmen.com
Scan Status Ok
Last Scan2026-02-24T08:07:44+00:00
Next Scan 2026-03-26T08:07:44+00:00

Last Scan

Scanned2026-02-24T08:07:44+00:00
URL https://kinkmen.com/robots.txt
Domain IPs 104.21.28.186, 172.67.147.76, 2606:4700:3031::ac43:934c, 2606:4700:3036::6815:1cba
Response IP 172.67.147.76
Found Yes
Hash d0dd0a82f430063716c9c058cb592ad74d25ba10f2df2d7fe8bc0294ee16a545
SimHash 670dde427690

Groups

*

Rule Path
Disallow /signup
Disallow /join
Disallow /forgot-password
Disallow /my/
Disallow /*?
Allow /*?page=

adsbot-google

Rule Path
Disallow /signup
Disallow /join
Disallow /forgot-password
Disallow /my/
Disallow /*?
Allow /*?page=

nutch

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /signup
Disallow /join
Disallow /forgot-password
Disallow /my/
Disallow /*?
Allow /*?page=

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /signup
Disallow /join
Disallow /forgot-password
Disallow /my/
Disallow /*?
Allow /*?page=

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://kinkmen.com/sitemap.xml

Comments

  • Block ALL parameterized URLs (filters, search, sort, etc.)
  • Allow pagination explicitly
  • Google adsbot ignores robots.txt unless specifically named!