maxweb.com
robots.txt

Robots Exclusion Standard data for maxweb.com

Resource Scan

Scan Details

Site Domain maxweb.com
Base Domain maxweb.com
Scan Status Ok
Last Scan2025-11-13T15:21:16+00:00
Next Scan 2025-12-13T15:21:16+00:00

Last Scan

Scanned2025-11-13T15:21:16+00:00
URL https://maxweb.com/robots.txt
Domain IPs 172.66.40.143, 172.66.43.113, 2606:4700:3108::ac42:288f, 2606:4700:3108::ac42:2b71
Response IP 172.66.40.143
Found Yes
Hash 2003c8a175c6cd4c158b28bed66b80f687c31cfad7798907ac9148b686b64e59
SimHash 2ab58947d501

Groups

googlebot

Rule Path
Disallow /feed/
Disallow /feed
Disallow /search*
Disallow /resources/search*
Disallow /resources/the-basics/search*
Disallow /files*
Disallow /marcom/
Disallow /productinfo/
Disallow /myorder/
Disallow /secure/
Disallow /resources/productinfo/
Disallow /resources/viewforum_right.php
Disallow /resources/thread_right.php
Disallow /terms.php
Disallow /terms_jv.php
Disallow /domain-registration-new.php*

mediapartners-google*

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

*

Rule Path
Disallow /contactpage*
Disallow /projects.php
Disallow /search.php
Disallow /resources/search.php
Disallow /domain-registration-new.php*
Disallow /marcom/
Disallow /files/
Disallow /myorder/
Disallow /resources/productinfo/
Disallow /resources/viewforum_right.php
Disallow /resources/thread_right.php
Disallow /script/
Disallow /terms.php
Disallow /terms_jv.php
Disallow /services/search/
Disallow /services/search/search_right.php
Disallow /index_files/
Disallow /resources/css
Disallow /web/
Disallow /localtor/
Disallow /productinfo/
Disallow /services/
Disallow /secure/
Disallow /images/

Other Records

Field Value
sitemap https://maxweb.com/sitemap.xml

Warnings

  • `host` is not a known field.