porntiki.com
robots.txt

Robots Exclusion Standard data for porntiki.com

Resource Scan

Scan Details

Site Domain porntiki.com
Base Domain porntiki.com
Scan Status Ok
Last Scan4/21/2025, 7:54:27 AM
Next Scan 5/21/2025, 7:54:27 AM

Last Scan

Scanned4/21/2025, 7:54:27 AM
URL https://porntiki.com/robots.txt
Domain IPs 188.72.227.103
Response IP 188.72.227.103
Found Yes
Hash a27b8f03bd484a6dbf79fb859dffe9bdd952a1d5f2e40b7f7873da07257e6a60
SimHash 407bd8826898

Groups

*

Rule Path
Disallow /go
Disallow /video
Disallow /*/search/
Disallow /hdvideo
Disallow *?filter*
Disallow /o.php
Disallow /emb
Disallow /suggestions
Disallow /reports
Disallow /fpi
Disallow *?tst*

Other Records

Field Value
crawl-delay 2

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

Warnings

  • 2 invalid lines.