Log In Sign Up

delever.uz
robots.txt

Robots Exclusion Standard data for delever.uz

Resource Scan

Scan Details

Site Domain delever.uz
Base Domain delever.uz
Scan Status Ok
Last Scan2025-12-19T11:30:12+00:00
Next Scan 2026-01-18T11:30:12+00:00

Last Scan

Scanned2025-12-19T11:30:12+00:00
URL https://delever.uz/robots.txt
Redirect https://www.delever.uz/robots.txt
Redirect Domain www.delever.uz
Redirect Base delever.uz
Domain IPs 216.198.79.131, 64.29.17.131
Redirect IPs 216.198.79.195, 64.29.17.195
Response IP 216.198.79.67
Found Yes
Hash c2ed28571d6bda8e6683effee89bf1247056f927e002fcf43fd4b3735bfb0b44
SimHash 480d8cc0e592

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /admin/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yandex

Rule Path
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://delever.io/sitemap.xml
Back to top

Comments

  • Delever.io Robots.txt
  • https://delever.io
  • Sitemap
  • Block admin/internal paths
  • Allow all crawlers
  • Crawl-delay for less important bots
Back to top