/.well-known/

Log In Sign Up

hardporn.tube
robots.txt

Robots Exclusion Standard data for hardporn.tube

Archived Snapshots

Resource Scan

Scan Details

Site Domain	hardporn.tube
Base Domain	hardporn.tube
Scan Status	Ok
Last Scan	2024-11-18T06:38:25+00:00
Next Scan	2024-12-18T06:38:25+00:00

Last Scan

Scanned	2024-11-18T06:38:25+00:00
URL	https://hardporn.tube/robots.txt
Domain IPs	104.21.39.162, 172.67.146.189, 2606:4700:3035::ac43:92bd, 2606:4700:3037::6815:27a2
Response IP	104.21.39.162
Found	Yes
Hash	ad35e1ad884e9b236ce55839fe9f6b2a47c9fd7455ffd442adf01674bd398086
SimHash	13149c06cb30

Groups

*

Rule

Path

Disallow

ahrefsbot

Rule

Path

Disallow

/

mj12bot

Rule

Path

Disallow

/

semrushbot-sa

Rule

Path

Disallow

/

semrushbot-ba

Rule

Path

Disallow

/

semrushbot-si

Rule

Path

Disallow

/

semrushbot-swa

Rule

Path

Disallow

/

semrushbot-ct

Rule

Path

Disallow

/

semrushbot-bm

Rule

Path

Disallow

/

Back to top

Other Records

Field

Value

sitemap

https://hardporn.tube/sitemap.xml

Back to top

Comments

www.robotstxt.org/
www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

Back to top

Warnings

`host` is not a known field.

Back to top