maxumownersclub.com
robots.txt

Robots Exclusion Standard data for maxumownersclub.com

Resource Scan

Scan Details

Site Domain maxumownersclub.com
Base Domain maxumownersclub.com
Scan Status Ok
Last Scan2024-11-13T20:09:53+00:00
Next Scan 2024-11-20T20:09:53+00:00

Last Scan

Scanned2024-11-13T20:09:53+00:00
URL https://maxumownersclub.com/robots.txt
Domain IPs 104.25.116.12, 104.25.117.12, 172.67.65.95
Response IP 172.67.65.95
Found Yes
Hash f5fb97cb8e4d4dd391f16ecbc0efe6072e244a35b8d236ab6529920123f60671
SimHash 4b3d1064a713

Groups

*

Rule Path
Disallow /forums/clientscript/
Disallow /forums/includes/
Disallow /forums/install/
Disallow /forums/customavatars/
Disallow /forums/signatureuploads/

*

Rule Path
Disallow /forums/printthread.php
Disallow /forums/cron.php

googlebot

Rule Path
Disallow /forums/external-link/

*

Rule Path
Disallow /ad_tags/

boardtracker

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

the knowledge ai

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.maxumownersclub.com/forums/sitemap_index.xml.gz

Comments

  • Forum Folders
  • Forum Files
  • Outbound Link Exclude
  • Backup Ad Tags