types.pl
robots.txt

Robots Exclusion Standard data for types.pl

Resource Scan

Scan Details

Site Domain types.pl
Base Domain types.pl
Scan Status Ok
Last Scan2024-10-04T01:47:11+00:00
Next Scan 2024-10-05T01:47:11+00:00

Last Scan

Scanned2024-10-04T01:47:11+00:00
URL https://types.pl/robots.txt
Domain IPs 2600:3c00::f03c:92ff:fef5:47d5, 45.79.51.221
Response IP 45.79.51.221
Found Yes
Hash 66ecc290e1c1eda8defff2d9b682c37cfce093f0d3c5109c33c422d36bcdf6b3
SimHash 9a31d9e47762

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

checkmarknetwork/1.0 (+https://www.checkmarknetwork.com/spider.html)

No rules defined. All paths allowed.

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Via https://seirdy.one/robots.txt
  • Via https://www.videolan.org/robots.txt