edubase.net
robots.txt

Robots Exclusion Standard data for edubase.net

Resource Scan

Scan Details

Site Domain edubase.net
Base Domain edubase.net
Scan Status Ok
Last Scan2024-05-01T00:12:16+00:00
Next Scan 2024-05-31T00:12:16+00:00

Last Scan

Scanned2024-05-01T00:12:16+00:00
URL https://edubase.net/robots.txt
Redirect https://www.edubase.net/robots.txt
Redirect Domain www.edubase.net
Redirect Base edubase.net
Domain IPs 172.66.40.242, 172.66.43.14, 2606:4700:3108::ac42:28f2, 2606:4700:3108::ac42:2b0e
Redirect IPs 172.66.40.242, 172.66.43.14, 2606:4700:3108::ac42:28f2, 2606:4700:3108::ac42:2b0e
Response IP 172.66.40.242
Found Yes
Hash 56b8bfa5cff9977d43e1d5bbd72763e30bbda6262851d0ccecfa34916bed732b
SimHash ed08ca229791

Groups

httrack

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /do/
Disallow /api/

Other Records

Field Value
sitemap https://www.edubase.net/sitemap.xml

Comments

  • Disable website downloaders
  • Allow any other