cugetliber.ro
robots.txt

Robots Exclusion Standard data for cugetliber.ro

Resource Scan

Scan Details

Site Domain cugetliber.ro
Base Domain cugetliber.ro
Scan Status Ok
Last Scan2024-09-22T13:56:38+00:00
Next Scan 2024-09-29T13:56:38+00:00

Last Scan

Scanned2024-09-22T13:56:38+00:00
URL https://cugetliber.ro/robots.txt
Domain IPs 104.21.88.145, 172.67.183.152, 2606:4700:3030::6815:5891, 2606:4700:3034::ac43:b798
Response IP 104.21.88.145
Found Yes
Hash fb65274afc51ed695cca38150d88fce632ffcf93198660284e2facea55303a51
SimHash 581e8101e7b8

Groups

mj12bot
bytespider
blexbot
semrushbot
amazonbot
petalbot
mojeekbot
dataforseobot
dotbot
universalfeedparser
ias-va
ias-ie
bingbot
claudebot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /test/
Disallow /old/

Other Records

Field Value
sitemap https://cugetliber.ro/sitemap.xml