hypnotherapy-directory.org.uk
robots.txt
Robots Exclusion Standard data for hypnotherapy-directory.org.uk
Resource Scan
Scan Details
| Site Domain | hypnotherapy-directory.org.uk |
| Base Domain | hypnotherapy-directory.org.uk |
| Scan Status | Ok |
| Last Scan | 2025-04-28T22:51:56+00:00 |
| Next Scan | 2025-05-28T22:51:56+00:00 |
Last Scan
| Scanned | 2025-04-28T22:51:56+00:00 |
| URL | https://hypnotherapy-directory.org.uk/robots.txt |
| Redirect | https://www.hypnotherapy-directory.org.uk/robots.txt |
| Redirect Domain | www.hypnotherapy-directory.org.uk |
| Redirect Base | hypnotherapy-directory.org.uk |
| Domain IPs | 3.9.32.3, 35.178.20.34, 35.179.27.254 |
| Redirect IPs | 104.26.14.7, 104.26.15.7, 172.67.68.75, 2606:4700:20::681a:e07, 2606:4700:20::681a:f07, 2606:4700:20::ac43:444b |
| Response IP | 104.26.14.7 |
| Found | Yes |
| Hash | 696e4ab85e2f1ff79bafc6709d61d8d903685f941c9aba4e82ccb61aa6af9552 |
| SimHash | 6b059c02a7d9 |
Groups
slurp
baiduspider
ahrefsbot
semrushbot-sa
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /xhr/ |
| Disallow | /search.php |
| Disallow | /search.html |
| Disallow | /uploads/ |
| Disallow | /reportenquiry.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /xhr/ |
| Disallow | /search.php |
| Disallow | /search.html |
| Disallow | /uploads/ |
| Disallow | /reportenquiry.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | *?date* |
| Disallow | *?audience* |
| Disallow | *?location* |
| Disallow | *?topic%5B%5D* |
| Disallow | *?summary* |
| Disallow | *?cal* |
| Disallow | *?radius* |
| Disallow | *?per_page* |
| Disallow | *%26date* |
| Disallow | *%26audience* |
| Disallow | *%26location* |
| Disallow | *%26topic%5B%5D* |
| Disallow | *%26summary* |
| Disallow | *%26cal* |
| Disallow | *%26radius* |
| Disallow | *%26per_page* |
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /xhr/ |
| Disallow | /search.php |
| Disallow | /search.html |
| Disallow | /uploads/ |
| Disallow | /reportenquiry.php |
| Disallow | /toplistingterms.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hypnotherapy-directory.org.uk/sitemap.xml |