xhamster.one
robots.txt

Robots Exclusion Standard data for xhamster.one

Resource Scan

Scan Details

Site Domain xhamster.one
Base Domain xhamster.one
Scan Status Ok
Last Scan2026-02-08T15:29:11+00:00
Next Scan 2026-03-10T15:29:11+00:00

Last Scan

Scanned2026-02-08T15:29:11+00:00
URL https://xhamster.one/robots.txt
Domain IPs 104.21.47.150, 172.67.148.119, 2606:4700:3032::6815:2f96, 2606:4700:3033::ac43:9477
Response IP 172.67.148.119
Found Yes
Hash 8c29ef63a45a6dfcda82e8a71c49baa96ba71022e1f6012d263e0517aa012299
SimHash 400a8cf2d9b7

Groups

*

Rule Path
Disallow */*/date/
Disallow */*/duration/
Disallow */search/*/date/
Disallow */search/*/duration/
Disallow */model/*/date/
Disallow */model/*/duration/
Disallow */tag/*/date/
Disallow */tag/*/duration/
Allow */all/date/
Allow */all/duration/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1