sexvolg.red
robots.txt

Robots Exclusion Standard data for sexvolg.red

Resource Scan

Scan Details

Site Domain sexvolg.red
Base Domain sexvolg.red
Scan Status Ok
Last Scan2024-05-26T16:36:01+00:00
Next Scan 2024-06-25T16:36:01+00:00

Last Scan

Scanned2024-05-26T16:36:01+00:00
URL https://sexvolg.red/robots.txt
Domain IPs 104.21.61.175, 172.67.212.151, 2606:4700:3034::6815:3daf, 2606:4700:3035::ac43:d497
Response IP 172.67.212.151
Found Yes
Hash 22f6acf9b224edb4473810ba4e7f77ec977742f9108e7f59bc67f688f5e56fd6
SimHash 4108ce6aa7d0

Groups

*

Rule Path
Disallow /my/
Disallow /agent/
Disallow /my/join.php
Disallow /search/
Disallow /adv/
Disallow /booking/
Disallow /usloviy/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

Warnings

  • `host` is not a known field.