adevait.com
robots.txt

Robots Exclusion Standard data for adevait.com

Resource Scan

Scan Details

Site Domain adevait.com
Base Domain adevait.com
Scan Status Ok
Last Scan2025-09-16T20:13:48+00:00
Next Scan 2025-10-16T20:13:48+00:00

Last Scan

Scanned2025-09-16T20:13:48+00:00
URL https://adevait.com/robots.txt
Domain IPs 216.198.79.1
Response IP 216.198.79.1
Found Yes
Hash ff906c50c3bcfc041d89797bc4e6499141cb7320de72ac504cc632b41c68e964
SimHash 800508504752

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /search?q=*
Disallow /cdn-cgi/

googlebot

Rule Path Comment
Disallow /cdn-cgi/ -
Allow *.css -
Allow *.js global

*

Rule Path
Disallow /_next/

*

Rule Path
Disallow /login?

*

Rule Path
Disallow /login/*

Other Records

Field Value
sitemap https://adevait.com/sitemap.xml

Comments

  • Googlebot
  • Prevent crawling login with query param