Log In Sign Up

ofertelecatalog.ro
robots.txt

Robots Exclusion Standard data for ofertelecatalog.ro

Resource Scan

Scan Details

Site Domain ofertelecatalog.ro
Base Domain ofertelecatalog.ro
Scan Status Ok
Last Scan2024-09-28T18:18:53+00:00
Next Scan 2024-10-05T18:18:53+00:00

Last Scan

Scanned2024-09-28T18:18:53+00:00
URL https://ofertelecatalog.ro/robots.txt
Redirect https://www.ofertelecatalog.ro/robots.txt
Redirect Domain www.ofertelecatalog.ro
Redirect Base ofertelecatalog.ro
Domain IPs 104.21.13.118, 172.67.167.240, 2606:4700:3032::6815:d76, 2606:4700:3035::ac43:a7f0
Redirect IPs 2600:9000:2721:200:14:cb3d:2180:93a1, 2600:9000:2721:7400:14:cb3d:2180:93a1, 2600:9000:2721:a000:14:cb3d:2180:93a1, 2600:9000:2721:a800:14:cb3d:2180:93a1, 2600:9000:2721:c400:14:cb3d:2180:93a1, 2600:9000:2721:c800:14:cb3d:2180:93a1, 2600:9000:2721:d000:14:cb3d:2180:93a1, 2600:9000:2721:d600:14:cb3d:2180:93a1, 3.165.102.17, 3.165.102.81, 3.165.102.92, 3.165.102.95
Response IP 3.165.102.17
Found Yes
Hash 393c08e7f4f11057e5873a9b0f6dc2f595c12750a1181ef4d2dc20a1fd656055
SimHash c71de6537499

Groups

*

Rule Path
Allow /
Disallow /cauta/*
Disallow /shopping-list/
Disallow /click-out/
Disallow /index.php/click-out/
Disallow /admin/
Disallow /cdn-cgi/
Disallow /oferte/*?sort=relevance&page=*&*
Allow /oferte/*?sort=relevance&page=*
Disallow /oferte/*?page=*&*
Allow /oferte/*?page=*
Disallow /oferte/*?*
Disallow /branduri/*?page=*&*
Allow /branduri/*?page=*
Disallow /branduri/*?*
Disallow /magazine/*?page=*&*
Allow /magazine/*?page=*
Disallow /magazine/*?*
Disallow /orase/*?page=*&*
Allow /orase/*?page=*
Disallow /orase/*?*
Disallow /noi-cataloage?page=*&*
Allow /noi-cataloage?page=*
Disallow /noi-cataloage?*
Disallow /pliante-aproape-expirate?page=*&*
Allow /pliante-aproape-expirate?page=*
Disallow /pliante-aproape-expirate?*
Disallow /cataloage-populare?page=*&*
Allow /cataloage-populare?page=*
Disallow /cataloage-populare?*
Disallow /cataloage-recomandate?page=*&*
Allow /cataloage-recomandate?page=*
Disallow /cataloage-recomandate?*
Disallow /noi-oferte?page=*&*
Allow /noi-oferte?page=*
Disallow /noi-oferte?*
Disallow /ofertele-aproape-expirate?page=*&*
Allow /ofertele-aproape-expirate?page=*
Disallow /ofertele-aproape-expirate?*
Disallow /oferte-populare?page=*&*
Allow /oferte-populare?page=*
Disallow /oferte-populare?*
Disallow /oferte-recomandate?page=*&*
Allow /oferte-recomandate?page=*
Disallow /oferte-recomandate?*

adsbot-google

Rule Path
Disallow /click-out/
Disallow /admin/

*
adsbot-google

Rule Path
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/
Disallow /cdn-cgi/images/trace/
Disallow /cdn-cgi/rum
Disallow /cdn-cgi/scripts/
Disallow /cdn-cgi/styles/
Disallow /cdn-cgi/zaraz/

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
mj12bot
ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.ofertelecatalog.ro/sitemap.xml
Back to top