psychotherapynetworker.org
robots.txt

Robots Exclusion Standard data for psychotherapynetworker.org

Resource Scan

Scan Details

Site Domain psychotherapynetworker.org
Base Domain psychotherapynetworker.org
Scan Status Ok
Last Scan2024-09-22T12:00:03+00:00
Next Scan 2024-09-29T12:00:03+00:00

Last Scan

Scanned2024-09-22T12:00:03+00:00
URL https://psychotherapynetworker.org/robots.txt
Redirect https://www.psychotherapynetworker.org/robots.txt
Redirect Domain www.psychotherapynetworker.org
Redirect Base psychotherapynetworker.org
Domain IPs 3.131.150.69
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash c9980d49f11e941a092fc146db97c13b3d457a7072fa2b38d2701eba64e4fce7
SimHash d25c10784ab8

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /*?last_initial=
Disallow /*?orderby=
Disallow /*?filters=
Disallow /*?keywords=
Disallow /*%26last_initial%3D
Disallow /*%26orderby%3D
Disallow /*%26filters%3D
Disallow /*%26keywords%3D
Disallow /21600225/Psychotherapy_Networker$
Disallow /21600225/Psychotherapy_Networker/
Disallow /*?__hstc=
Disallow /*?__hssc=
Disallow /*?__hsfp=
Disallow /*?_hsenc=
Disallow /*?_hsmi=
Disallow /*%26__hstc%3D
Disallow /*%26__hssc%3D
Disallow /*%26__hsfp%3D
Disallow /*%26_hsenc%3D
Disallow /*%26_hsmi%3D

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

riddlerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

whatcms

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

nimbostratus

Rule Path
Disallow /

httrack

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

cocolyzebot

Rule Path
Disallow /

domcopbot

Rule Path
Disallow /

traackr

Rule Path
Disallow /

bomborabot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

webtechbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

seekport

Rule Path
Disallow /

internet-structure-research-project-bot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

onalyticabot

Rule Path
Disallow /

sbl-bot

Rule Path
Disallow /

pubmatic crawler bot

Rule Path
Disallow /

bvbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

admantx

Rule Path
Disallow /

adbeat

Rule Path
Disallow /

embed.ly

Rule Path
Disallow /

semantic-visions

Rule Path
Disallow /

voluumdsp

Rule Path
Disallow /

wc-test-dev-bot

Rule Path
Disallow /

gulperbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.psychotherapynetworker.org/sitemap_index.xml

Comments

  • I hope you brought the tacos
  • Disallow WordPress Parameters
  • Disallow Google Ad Manager Paths
  • Disallow HubSpot Parameters
  • Disallow Agents