test.mobilism.org
robots.txt

Robots Exclusion Standard data for test.mobilism.org

Resource Scan

Scan Details

Site Domain test.mobilism.org
Base Domain mobilism.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-02T19:26:46+00:00
Next Scan 2026-01-31T19:26:46+00:00

Last Successful Scan

Scanned2024-12-14T23:41:13+00:00
URL https://test.mobilism.org/robots.txt
Redirect https://forum.mobilism.org/robots.txt
Redirect Domain forum.mobilism.org
Redirect Base mobilism.org
Domain IPs 104.26.14.213, 104.26.15.213, 172.67.71.168, 2606:4700:20::681a:ed5, 2606:4700:20::681a:fd5, 2606:4700:20::ac43:47a8
Redirect IPs 104.26.14.213, 104.26.15.213, 172.67.71.168, 2606:4700:20::681a:ed5, 2606:4700:20::681a:fd5, 2606:4700:20::ac43:47a8
Response IP 172.67.71.168
Found Yes
Hash 2bf75e847a3fb03340af11c80894e12247fc2dee65de2f251e9b8989a2f71fc8
SimHash 0a6cd8b163c0

Groups

*

Rule Path
Disallow /style.php
Disallow /memberlist.php

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /viewtopic.php
Disallow /style.php
Disallow /memberlist.php

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /