linkpipi.com
robots.txt

Robots Exclusion Standard data for linkpipi.com

Resource Scan

Scan Details

Site Domain linkpipi.com
Base Domain linkpipi.com
Scan Status Ok
Last Scan2025-12-12T20:34:57+00:00
Next Scan 2025-12-19T20:34:57+00:00

Last Scan

Scanned2025-12-12T20:34:57+00:00
URL https://linkpipi.com/robots.txt
Redirect https://www.linkpipi.com/robots.txt
Redirect Domain www.linkpipi.com
Redirect Base linkpipi.com
Domain IPs 104.18.51.220, 104.18.54.253, 2606:4700:3114::6812:36fd, 2606:4700:3118::6812:33dc
Redirect IPs 104.18.51.220, 104.18.54.253, 2606:4700:3114::6812:36fd, 2606:4700:3118::6812:33dc
Response IP 104.18.51.220
Found Yes
Hash 271df197aacc0ffdefe0e8baa29df3e43dd7b2b8a5aee0133baea0a82c5f3ba7
SimHash 087cc8a07b10

Groups

*

Rule Path
Disallow /*about.html$
Disallow /*contact.html$
Disallow /*guidance.html$
Disallow /*disclaimer.html$
Disallow /*dmca.html$
Disallow /*privacyPolicy.html$
Disallow /*rules.html$
Disallow /search
Disallow /*/search

baiduspider*
sogou*

Rule Path
Disallow /

scrapy
semrushbot
ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
linguee

Rule Path
Disallow /