sexxsimf.club
robots.txt

Robots Exclusion Standard data for sexxsimf.club

Resource Scan

Scan Details

Site Domain sexxsimf.club
Base Domain sexxsimf.club
Scan Status Ok
Last Scan2024-09-21T03:24:18+00:00
Next Scan 2024-10-21T03:24:18+00:00

Last Scan

Scanned2024-09-21T03:24:18+00:00
URL https://sexxsimf.club/robots.txt
Domain IPs 104.21.59.202, 172.67.183.134, 2606:4700:3031::6815:3bca, 2606:4700:3031::ac43:b786
Response IP 172.67.183.134
Found Yes
Hash 2c7e3430582588f557a20eea578297f27df67054e6e4ad32bd394edd87cae3fa
SimHash 7108066287d2

Groups

*

Rule Path
Disallow /my/
Disallow /agent/
Disallow /my/join.php
Disallow /adv/
Disallow /usloviy/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

Warnings

  • `host` is not a known field.