shpock.com
robots.txt

Robots Exclusion Standard data for shpock.com

Resource Scan

Scan Details

Site Domain shpock.com
Base Domain shpock.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-02T19:45:27+00:00
Next Scan 2024-11-16T19:45:27+00:00

Last Successful Scan

Scanned2024-05-17T13:04:06+00:00
URL https://shpock.com/robots.txt
Redirect https://www.shpock.com/robots.txt
Redirect Domain www.shpock.com
Redirect Base shpock.com
Domain IPs 176.9.12.65, 176.9.15.229, 46.4.134.8, 46.4.70.116, 46.4.70.190, 46.4.70.194
Redirect IPs 176.9.12.65, 176.9.15.229, 46.4.134.8, 46.4.70.116, 46.4.70.190, 46.4.70.194
Response IP 176.9.15.229
Found Yes
Hash a39b2d4441cf492d3c693c51fb707d06456454cf6a17153a94db706f26670045
SimHash a5dc59dcc443

Groups

*

Rule Path
Disallow /*%3D%3D*
Disallow /b/
Disallow /en-gb/users/*/terms-conditions
Disallow /de-de/users/*/terms-conditions
Disallow /de-at/users/*/terms-conditions
Disallow /*/e-mail-newsletter-unsubscribe*
Disallow /en-gb/s/
Disallow /de-de/s/
Disallow /de-at/s/
Disallow /*search?q=*
Disallow /*/users/*/reviews

myloc managed it ag

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

expo9

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sitemaps.shpock.com/siteindex.xml.gz