gretsch-talk.com
robots.txt

Robots Exclusion Standard data for gretsch-talk.com

Resource Scan

Scan Details

Site Domain gretsch-talk.com
Base Domain gretsch-talk.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-22T11:30:22+00:00
Next Scan 2024-06-20T11:30:22+00:00

Last Successful Scan

Scanned2023-08-25T05:14:21+00:00
URL https://gretsch-talk.com/robots.txt
Domain IPs 104.21.29.107, 172.67.171.116, 2606:4700:3033::6815:1d6b, 2606:4700:3035::ac43:ab74
Response IP 172.67.171.116
Found Yes
Hash f946c8a7ac926f88ca5d0ddf1e20d3404d1e8eaa13f6d945251d5d3761faa083
SimHash 28704970651b

Groups

boardreader

Rule Path
Disallow /

boardtracker

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow /tmp/
Disallow /test/
Disallow /ssh/
Disallow /xcache/
Disallow /plesk-stat/
Disallow /picture_library/
Disallow /phpmyadmin/*
Disallow /dev/
Disallow /chat/
Disallow /calendar/
Disallow /ads-direct/*
Disallow /fundraiser/*
Disallow /namm08/*
Disallow /forum/archive/*/
Disallow /Hide_vB_Forum/*/

Other Records

Field Value
crawl-delay 2