import40.ru
robots.txt

Robots Exclusion Standard data for import40.ru

Resource Scan

Scan Details

Site Domain import40.ru
Base Domain import40.ru
Scan Status Ok
Last Scan2025-03-08T15:17:53+00:00
Next Scan 2025-03-15T15:17:53+00:00

Last Scan

Scanned2025-03-08T15:17:53+00:00
URL https://import40.ru/robots.txt
Domain IPs 104.21.3.131, 172.67.130.185, 2606:4700:3033::ac43:82b9, 2606:4700:3037::6815:383
Response IP 104.21.3.131
Found Yes
Hash 48e91769df69da671eac3ad6172e04f1c325677b4685f3cac13d1dd6b8a330c1
SimHash 6b0cd4d022c8

Groups

*

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /tmp/
Disallow /xmlrpc/
Disallow /backup/
Disallow /phpmyadmin/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /search/
Disallow /Arhive/

petalbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://import40.ru/index.php?option=com_xmap&sitemap=1&view=xml