tbh.co-shaoghal.net
robots.txt

Robots Exclusion Standard data for tbh.co-shaoghal.net

Resource Scan

Scan Details

Site Domain tbh.co-shaoghal.net
Base Domain co-shaoghal.net
Scan Status Ok
Last Scan2024-09-27T08:37:04+00:00
Next Scan 2024-09-28T08:37:04+00:00

Last Scan

Scanned2024-09-27T08:37:04+00:00
URL https://tbh.co-shaoghal.net/robots.txt
Domain IPs 5.75.134.141
Response IP 5.75.134.141
Found Yes
Hash 06b59f22aad55a02ed461c39d82956adfbebf30f44ae2e5bbaa773b897ed50a2
SimHash 0e7d9ae0f030

Groups

user-agent: ccbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

fedicrawl/1.0

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

facebookexternalhit/1.0

Rule Path
Disallow /

facebot

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

storebot-google

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow