thumper-talk.us
robots.txt

Robots Exclusion Standard data for thumper-talk.us

Resource Scan

Scan Details

Site Domain thumper-talk.us
Base Domain thumper-talk.us
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-17T13:54:18+00:00
Next Scan 2024-10-15T13:54:18+00:00

Last Successful Scan

Scanned2023-09-22T08:28:02+00:00
URL https://thumper-talk.us/robots.txt
Redirect https://www.thumpertalk.com/robots.txt
Redirect Domain www.thumpertalk.com
Redirect Base thumpertalk.com
Domain IPs 104.16.248.51, 104.16.249.51
Redirect IPs 104.17.97.5, 104.17.98.5, 2606:4700::6811:6105, 2606:4700::6811:6205
Response IP 104.17.98.5
Found Yes
Hash 2b7fadc10cd6d9f22fa66a42a819e1e29f5821ec1f82e085473572e42357496a
SimHash 6959184089c7

Groups

aipbot
psbot
yandex

Rule Path
Disallow /

*

Rule Path
Disallow /link/click/
Disallow /unsubscribe/
Disallow /profile/
Disallow /*?trlv=*
Disallow /*%26trlv%3D*

Other Records

Field Value
sitemap https://thumpertalk.com/sitemap.php