absulo.ro
robots.txt

Robots Exclusion Standard data for absulo.ro

Resource Scan

Scan Details

Site Domain absulo.ro
Base Domain absulo.ro
Scan Status Ok
Last Scan2024-06-07T00:23:01+00:00
Next Scan 2024-07-07T00:23:01+00:00

Last Scan

Scanned2024-06-07T00:23:01+00:00
URL https://absulo.ro/robots.txt
Domain IPs 104.26.0.83, 104.26.1.83, 172.67.72.244, 2606:4700:20::681a:153, 2606:4700:20::681a:53, 2606:4700:20::ac43:48f4
Response IP 104.26.1.83
Found Yes
Hash 10626c131157aac2692f5257281e4c7dabef5a092affb1542eed476e23156d88
SimHash e10cf862eb93

Groups

*

Rule Path
Allow /
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /wishlist/

Other Records

Field Value
crawl-delay 120

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://absulo.ro/media/sitemap/sitemap_ro.xml

Comments

  • Directories
  • Paths (clean URLs)