Log In Sign Up

pasveikink.net
robots.txt

Robots Exclusion Standard data for pasveikink.net

Resource Scan

Scan Details

Site Domain pasveikink.net
Base Domain pasveikink.net
Scan Status Ok
Last Scan2025-04-24T15:57:27+00:00
Next Scan 2025-05-01T15:57:27+00:00

Last Scan

Scanned2025-04-24T15:57:27+00:00
URL https://pasveikink.net/robots.txt
Domain IPs 104.21.46.253, 172.67.143.134, 2606:4700:3033::ac43:8f86, 2606:4700:3035::6815:2efd
Response IP 172.67.143.134
Found Yes
Hash 41dc85390e68413635c46d86a41c7aec134e4a3a0ef5a26415dc08de0ea313bc
SimHash 0e75dd103193

Groups

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

scoutjet

Rule Path
Allow /

yandex

Rule Path
Allow /

baiduspider

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

nerdybot

Rule Path
Disallow /

admantx platform semantic analyzer - admantx inc. - www.admantx.com - support@admantx.com

Rule Path
Disallow /

a6-indexer/1.0

Rule Path
Disallow /

wesee:ads/pagebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

a6-indexer/1.0 (http://www.a6corp.com/a6-web-scraping-policy/)

Rule Path
Disallow /
Back to top

Comments

  • Adsense
  • Blekko
  • CommonCrawl
Back to top