webhostingdiscussion.net
robots.txt

Robots Exclusion Standard data for webhostingdiscussion.net

Resource Scan

Scan Details

Site Domain webhostingdiscussion.net
Base Domain webhostingdiscussion.net
Scan Status Ok
Last Scan2025-12-10T00:23:03+00:00
Next Scan 2025-12-17T00:23:03+00:00

Last Scan

Scanned2025-12-10T00:23:03+00:00
URL https://webhostingdiscussion.net/robots.txt
Redirect https://www.webhostingdiscussion.net/robots.txt
Redirect Domain www.webhostingdiscussion.net
Redirect Base webhostingdiscussion.net
Domain IPs 104.21.2.35, 172.67.128.170, 2606:4700:3034::ac43:80aa, 2606:4700:3036::6815:223
Redirect IPs 104.21.2.35, 172.67.128.170, 2606:4700:3034::ac43:80aa, 2606:4700:3036::6815:223
Response IP 104.21.2.35
Found Yes
Hash 53cae47535a2c7cb2309935408f1ed8bbdfc9e0d2d0edcf303f73206b9c72099
SimHash ad105607cb98

Groups

*

Rule Path
Disallow /directory/*
Disallow /wordpress-kb/*
Disallow /directory.php
Disallow /amazon-online/*
Disallow /advertise.php
Disallow /submit.php
Disallow /amazonstore/*
Disallow /Q2A/login
Disallow /Q2A/register
Disallow /Q2A/user
Disallow /forums/index.php?action=help*
Disallow /forums/index.php?action=login*
Disallow /forums/index.php?action=register*
Disallow /forums/index.php?action=admin*
Disallow /forums/index.php?action=post*
Disallow /forums/index.php?action=who*
Disallow /forums/index.php?action=profile*

Other Records

Field Value
sitemap https://www.webhostingdiscussion.net/blog/sitemap_index.xml
sitemap https://www.webhostingdiscussion.net/news/sitemap_index.xml
sitemap https://www.webhostingdiscussion.net/sitemap_index.xml
sitemap https://www.webhostingdiscussion.net/forums/sitemap.xml