r18.video
robots.txt

Robots Exclusion Standard data for r18.video

Resource Scan

Scan Details

Site Domain r18.video
Base Domain r18.video
Scan Status Ok
Last Scan2024-10-08T13:11:34+00:00
Next Scan 2024-11-07T13:11:34+00:00

Last Scan

Scanned2024-10-08T13:11:34+00:00
URL https://r18.video/robots.txt
Domain IPs 104.21.15.35, 172.67.161.76, 2606:4700:3030::ac43:a14c, 2606:4700:3032::6815:f23
Response IP 172.67.161.76
Found Yes
Hash 0ef991a12fb90f7f4e0a4d1422602c7557f3d4ed0106b57c3e9123945194a149
SimHash 481c5d78ec92

Groups

ia_archiver

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

pimeyes

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /access/
Disallow /review/

Other Records

Field Value
sitemap https://r18.video/sitemap.xml